CURRENT  JOB  EVALUATION  PRACTICES 
IN   HOSPITALS:   AN   APPRAISAL 


By 

ARTHUR  FURMAN  BELOTE 


A    DISSERTATION    PRESENTED    TO    THE    GRADUATE    COUNCIL    OF 

THE    UNIVERSITY    OF    FLORIDA 

IN    PARTIAL    FULFILLMENT    OF    THE    REQUIREMENTS    FOR    THE 

DEGREE   OF   DOCTOR   OF    PHILOSOPHY 


UNIVERSITY  OF  FLORIDA 
August,  1962 


UNIVERSITY  OF   FLORIDA 


3  1262  08552  2455 


ACKNOWLEDGMENT 

The  author  would  like  to  express  appreciation  for 
assistance  rendered  by  the  following  members  of  the 
dissertation  committee t   Dr.  Ralph  Blodgett,  Dr.  William 
Fox,  Dr.  Donald  J.  Hart,  Dr.  John  B.  McFerrin  and 
Dr.  Ralph  Thompson.  A  particular  expression  of  gratitude 
for  helpful  suggestions  and  criticisms  relevant  to  the 
problem  under  consideration  is  due  Dr.  McFerrin,  Chairman 
of  the  Committee  and  Dr.  William  Fox  under  whose  guidance 
the  dissertation  was  written. 

In  addition,  a  word  of  appreciation  to  the  many 
hospital  administrators  and  personnel  managers  v*io  gave 
so  freely  of  their  time  in  answering  questions  and  filling 
out  survey  sheets.  Without  their  cooperation  this  study 
would  not  have  been  possible. 

June,  1962  Arthur  Furman  Belote 

Norfolk,  Virginia 


ill 


TABLE  OF  CONTENTS 

Page 
Acknowledgments lii 

List  of  Tables v 

Chapter 

Z.    Introduction 1 

II.    The  Evolution  of  Job  Evaluation: 

A  Historical  Perspective IX 

III.    Results  of  the  Hospital  Study 68 

IV.    Major  Considerations  in  Developing  a 
Point  Plan  of  Job  Evaluation  for 
Hospitals 168 

Bibliography 232 

Appendixe s. 246 


iv 


LIST  OF  TABLES 

Table  Page 

1«   Comparison  of  Job  Labor  Grade  Displace- 
ment for  Six  Different  Industrial 
Organizations 37 

2*   Average  Intercorrelations  of  Ratings  Using 
a  Simplified  Job  Evaluation  System 
and  the  NEMA  System 47 

3*   Coefficients  of  Reliability  for  Two  Labor 
and  Two  Management  Job  Evaluation 
Committee  Members •  •      49 

4«   Present  Status  of  Job  Evaluation  in 

Hospitals 92 

5*   Distribution  of  Formal  Hospital  Job  Eval- 
uation Plans  by  Type  (Combined  Survey 
Results) 94 

6*   Year  of  Establishment  of  Hospital  Job 
Evaluation  Plans  (Combined  Survey 
Results) 96 

7*   Length  of  Time  Required  to  Install  Hospital 
Job  Evaluation  Plans  by  Type  (Combined 
Survey  Results) 97 

8«   Number  of  Hospitals  Reporting  Use  of  Job 
Analyses  and  Descriptions  for  all 
Hospital  Jobs  (Combined  Survey  Results) .      99 

9.   Methods  Employed  by  Hospitals  to  Secure 
Information  for  Job  Descriptions 
(Combined  Survey  Results) 102 

10.   Person (s)  Responsible  for  Writing  Job 
Descriptions  for  the  Hospital 
(Combined  Survey  Results) 105 


Table  Page 

11.  Person  Involved  in  Final  Approval  of 

Hospital  Job  Descriptions  (Mailed 

SujTvey  Results  Only) 106 

12.  Extent  of  Hospital  Usage  of  Commvmity  Wage 

Surveys  in  Setting  Wage  Rates  (Combined 

Survey  Results) 107 

13.  Frequency  of  Hospital  Wage  Surveys 

(Conibined  Survey  Results) 108 

14.  Extent  of  Hospital  Usage  of  Job  De- 

scriptions Rather  than  Job  Titles 

in  Securing  Wage  information  (Combined 

Survey  Results) 110 

15.  Meeuns  Used  by  Hospitals  in  Undertaking 

Wage  Surveys  (Mailed  Survey  Results 

Only) Ill 

16.  1VP®s  of  Jobs  on  Which  Hospitals  Seek 

Wage  Information  (Mailed  Survey  Re- 
sults Only) 112 

17.  Sources  Contacted  by  Hospitals  in  Seeking 

Wage  Information  (Mailed  Survey 

Results  Only) 114 

18.  Titles  of  Hospital  Personnel  Comprising 

the  Job  Evaluation  Committee  (Listed 

in  Order  of  Frequency  of  Response) 

(Combined  Survey  Results) 117 

19.  Distribution  of  Nvmiber  of  Members  Serving 

on  the  Hospital  Job  Evaluation  Com- 
mittee (Combined  Survey  Results) 120 

20.  Individual  or  Group  Responsible  for  Devel- 

oping, Installing  and  Day-to-Day  Oper- 
ation of  the  Hospital  Job  Evaluation 
Plan  (Combined  Survey  Results) 124 

21.  Hospitals  Indicating  Automatic  Inclusion 

of  the  Immediate  Superior  in  the 

Rating  Group  (Combined  Survey  Rssults) . ,     127 

vi 


Table  Page 

22.  Distribution  of  NiOTber  of  Persons  Serving 

in  the  Hospital  Rating  Group  (Combined 

Survey  Results) 129 

23.  Title  of  Person (s)  Actually  Rating  Jobs 

in  the  Hospital  (Listed  in  Order  of 
Frequency  of  Response)  (Combined  Survey 
Results) 130 

24.  Methods  Used  by  Hospitals  in  Secxiring 

Acceptance  of  the  Job  Evaluation  Plan 
(Mailed  Suzrvey  Results  Only) 133 

25.  Factors  Used  in  Rating  Hospital  Jobs  (Based 

on  a  Total  of  50  Point  Plans) 138 

26.  Inter-Hospital  Comparison  of  Factor 

Weightings 143 

27.  Inter-Hospital  Comparison  of  the 

Factor  "Education" 146 

28.  Number  of  Degrees  for  Major  Factors  Used 

in  50  Hospital  Job  Evaluation  Plans 148 

29.  Extent  of  Usage  of  Factor  Reduction  in 

Hospital  Job  Evaluation  Programs  (Com- 
bined Suzrvey  Results) 150 

30.  Extent  of  Usage  of  Reliability  Chec3cs  on 

Hospital  Job  Evaluation  Plans  (Combined 

Survey  Results) ,.     153 

31.  Extent  of  Usage  of  Validity  Checks  on 

Hospital  Job  Evaluation  Plans  (Combined 

Svirvey  Results) 157 

32.  Problems  Encotintered  in  Operating  the  Job 

Evalxiation  Plan  in  the  Hospital  (Mailed 

Survey  Results  Only) 162 

33.  Master  Rating  Plan  for  Use  in  Rating 

Hospital  Jobs 176 

34.  Hypothetical  Key  Job  Rates  Showing  Relative 

Constemcy  Over  Time 215 

vii 


CHAPTER  I 
INTRODUCTION 

The  Logic  of  Job  Evaluation 

The  United  States  Department  of  Labor  defines  job 

evaluation  In  the  following  terms: 

The  complete  operation  of  determining 
the  value  of  an  Individual  job  In  ein 
orgeinlzatlon  In  relation  to  all  other 
jobs  In  the  organization.   It  begins 
with  the  job  analysis  to  obtain  job 
descriptions  and  includes  relating  the 
descriptions  by  some  system  designed 
to  determine  the  relative  value  of  the 
jobs  or  grouping  of  jobs* 

A  study  of  the  most  authoritative  writers  In  this  field 

reveals  a  general  agreement  as  to  the  definition  of  the  term* 

Although  job  evaluation  has  received  widespread 

acceptance,  especially  In  the  Industrial  area,  most  plans 

In  operation  today  leave  much  to  be  desired.  True,  a  great 

deal  of  escperlmentatlon  has  taken  place  and  a  number  of 


^United  States  Department  of  Labor,  Industrial  Job 
Evaluation  Systems  (Washington,  D.  C.t   Department  of  Labor, 
United  States  Employment  Service,  Occupational  Analysis  and 
Indv^rial  Services  Division,  October  1957),  p.  19. 


so-called  "authorities"  on  Job  evaluation  have  emerged;  how- 
ever, most  of  the  resultant  "scientific"  developments  have 
been  based  solely  on  the  opinions  of  these  authorities. 
Since  one  opinion  may  be  as  good  as  another,  the  process  of 
job  evaluation  still  retains  a  high  degree  of  subjectivity. 
The  evaluation  plan  must  be  relieved  of  this  sxibjectivity  if 
it  is  to  become  a  sound  tool  of  roamagement.   The  only  way  to 
achieve  this  objective  is  to  siibject  the  plan  to  systematic 
checks  on  its  validity  and  reliability. 

The  "theory"  underlying  the  development  of  a  valid  and 
reliable  Job  evaluation  plan  is  quite  logical  and  not  diffi- 
cult to  comprehend.   The  validity  concept  has  its  foundation 
in  the  development  of  independent,  external  criteria  of  going 
rates  for  key  jobs.   These  criteria  constitute  a  frame  of 
reference  for  testing  the  validity  of  the  plan  of  evaluation. 

Key  jobs,  in  order  for  their  going  rates  to  be  used  as 
effective  criteria,  must  not  be  in  over  or  under  supply  in 
the  labor  market  in  question.   If,  for  example,  a  job  is  in 
temporary  over supply,  the  effect  would  be  to  drive  the  wage 
rate  up.   Such  a  rate  would  not  represent  the  true  value  of 
that  job  relative  to  other  jobs  over  a  period  of  time.   On 
the  other  hzmd,  if  there  is  no  under  or  over  supply  of  such 
a  Job,  its  going  rate  does  reflect  inherent  Job  demands. 
There  is  no  conflict  between  the  internal  consistency  of 


rates  of  pay  for  job  demands  and  the  going  rates  for  key 
Jobs.  Consequently,  such  a  job  may  be  considered  a  key  job 
for  purposes  of  validation.  Furthermore,  if  a  series  of  such 
key  job  rates  is  used  to  establish  the  vgage  line,  the  organ- 
ization's wage  level  will  automatically  correspond  to  the 
wage  level  for  key  jobs  in  the  labor  market  in  question. 

From  the  foregoing  discussion  concerning  key  job  mar- 
ket rates  it  follows  that  if  all  jobs  were  key  jobs  there 
would  be  no  need  for  a  job  evaluation.  Under  such  a  condi- 
tion no  under  or  over  supply  would  exist  for  any  job.  Conse- 
quently, each  job  rate  would  reflect  the  inherent  demands  of 
the  market.  Each  job  as  priced  by  the  market  would  reflect 
the  true  value  of  that  job  relative  to  all  other  jobs  as  evi- 
denced by  the  going  rates  for  such  jobs.   Thus,  since  there 
would  be  no  unique  or  non-key  jobs,^  there  would  be  no  need 
for  a  system  designed  to  adequately  price  such  jobs.  Unfor- 
tunately, only  a  relatively  few  jobs  can  meet  the  qualifica- 
tions for  key  jobs.   This  is  particularly  true  with  reference 
to  the  constancy  of  the  job's  relative  value  over  a  period  of 
time.  Failure  on  this  point  alone  would  disqualify  all  but  a 


Unique  jobs  are  those  jobs  which  are  found  in  the 
labor  market  in  question  in  such  few  nximbers  that  an  adequate 
going  wage  rate  for  such  jobs  is  vinobtainable.   In  addition, 
many  such  jobs  contain  vmique  functions  which  may  not  be 
found  in  the  labor  market  in  question. 


few  jobs.  As  a  result,  it  becomes  necessary  to  establish  a 
program  of  job  evaluation  to  effectively  price  unique,  non- 
key  jobs.   The  ability  of  the  evaluation  plan  to  accurately 
price  such  non-key  jobs  is  dependent  upon  the  degree  of 
validity  of  the  plan. 

One  of  the  important  prerequisites  to  developing  a 
valid  job  evaluation  plan  is  to  make  certain  that  the  rating 
of  jobs  is  reliable.  Validity  cemnot  be  achieved  without 
reliability.  Reliability  of  job  rating  means  that  consist- 
ency in  rating  has  been  achieved.   Reliability  is  a  measvire 
of  the  consistency  with  which  a  rater  achieves  the  same  re- 
sults in  rating  the  same  jobs  from  time  to  time  or  the  con- 
sistency with  v^ich  other  raters  using  the  same  system  inde- 
pendently on  the  same  jobs  achieve  the  same  results.   If  inter- 
rater  reliability  is  lacking,  and   there  is  no  consistency  in 
the  job  ratings,  it  is  impossible  to  determine  whether  the 
system  is  valid  or  not.  If  the  plan  proves  non-valid,  the 
difficulty  might  be  traced  to  improper  ratings  rather  than  to 
improper  factor  weighting.   Such  a  condition  would  make  it 
virtually  impossible  to  assess  a  plan's  validity. 

On  the  other  hsmd,  even  though  a  system  may  have 
achieved  reliability  it  should  not  be  inferred  that  the  sys- 
tem is  also  valid.  Validity  must  be  achieved  in  its  own 
right.  Actually,  the  most  important  phase  of  developing  amd 


Implementing  a  program  of  job  evalxiatlon  is  in  testing  the 
plan  for  validity.  A  valid  plan  is  one  that  evaluates  or 
rates  key  jobs  in  the  same  relative  position  as  they  have 
been  evaluated  by  the  going  rates  for  such  Jobs  in  the  labor 
market  in  question.   Only  by  checking  on  its  validity  can  it 
be  determined  >(hether  the  plan  in  use  is  "correct"  (i.e., 
optimvmi  weighting  of  factors  for  purposes  of  achieving  valid 
ratings) . 

A  study  of  many  job  evaluation  plans  currently  in 
operation  suggests  little  recognition  of  the  in^ortance  of 
validating  the  plan.   In  a  sense  this  lack  is  understandable 
since  the  process  of  validation  is  of  relatively  recent  ori- 
gin. Also,  there  apparently  has  been  little  attempt  to 
propagate  the  idea.   In  general,  most  job  evaluation  systems 
are  built  upon  "authoritative  opinion."   This  constitutes  a 
rather  shaky  ground  upon  which  to  construct  so  import  am  t  a 
program  as  the  wage  program.   Job  evaluation,  to  be  effective, 
must  be  based  on  the  principles  set  forth  above.   To  approach 
the  problem  in  a  haphazard  way  negates  any  value  that  other- 
wise might  be  obtained  from  a  formal  system  of  valuing  Jobs. 
To  attempt  to  use  formal  job  evaluation  without  ascertaining 
its  validity  and  reliability  is  tantamount  to  aucbitrarily 
estoQ^lishing  wage  rates. 


Purpoae  of  Study 

The  primary  purpose  of  this  research  is  to  analyze 
hospital  practice  in  terms  of  the  concept  of  job  evaluation 
as  outlined  above  and.   concepts  as  to  good  practice  taken  from 
a  review  of  the  literature  in  this  field.  The  specific  ob> 
Jectives  of  the  study  are  as  follows: 


1.   To  present  the  more  iraportsmt  contribu- 
tions leading  to  the  development  of 
present  day  concepts  of  Job  evaluation, 

2*  To  ascertain  the  extent  to  which  hospi- 
tals make  use  of  Job  evaluation  as  a  means 
of  controlling  wage  administration. 

3.  To  determine  the  principal  types  of 
formal  Job  evaluation  techniques  in  use 
by  the  majority  of  hospitals.  Also,  to 
seek  information  on  which  type  of  eval- 
uation system  brings  the  most  satisfac- 
tory results. 

4.  To  examine  in  detail  the  methods  of  pro- 
gram construction  and  implementation  and 
to  evaluate  operational  problems  involved 
in  hospital  usage  of  Job  evaluation. 

5.  To  ascertain  the  extent  to  which  hospitals 
using  a  qiantitative  point  plan  of  Job 
evaluation  make  use  of  statistical  pro- 
cedures in  checking  on  the  validity  and 
reliability  of  such  plsms. 

6.  To  determine  Whether  or  not  a  generally 
acceptable  plan  for  evaluating  jobs  might 
be  established  to  serve  hospitals. 


It  is  hoped  that  making  this  information  available  to 
hospital  administrators  will  lead  to  more  adequate  and  effec- 
tive administrative  plamning  in  the  area  of  wage  amd  salary 
administration. 

Limitations  of  study 

This  study  is  based  upon  empirical  data  secured 
through  personal  interviews  with  hospital  administrators 
and  personnel  managers  and  a  mailed  inteirview  sheet.   It  was 
limited  to  those  hospitals  within  the  continental  United 
States.  However,  Federal  and  State  hospitals  were  excluded 
from  the  study.   It  was  deemed  best  to  eliminate  such  insti- 
tutions from  the  study  in  the  interest  of  securing  more  repce- 
sentative  data  since  all  Federal  government  hospitals  use  the 
same  evaluation  plan  emd  many  state  plans  are  patterned  after 
the  Federal  government's  plan. 

The  mailed  survey  was  restricted  to  hospitals  with  a 
bed  capacity  of  200  or  more  since  it  was  assxiraed  that  larger 
institutions  would  be  more  likely  to  use  foinnal  job  evalua- 
tion due  to  the  cost  amd  time  involved  in  establishing  such 
a  program.   In  the  personal  survey,  no  attempt  was  made  to 
select  hospitals  on  the  basis  of  size  or  type  of  ownership. 
However,  in  view  of  cost  limitations,  the  personal  survey  was 
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restricted  to  hospitals  on  the  East  coast  ranging  from 
Jacksonville,  Florida,  to  New  York  City  and  westward  to 
Pittsburgh,  Pennsylvania. 

And,  finally,  the  selection  of  hospitals  for  inclu- 
sion in  the  survey  was  not  made  on  a  random  basis.   Conse- 
quently, sampling  theory  was  not  applicable  for  purposes  of 
establishing  statistical  reliability  of  predictions.  Never- 
theless, since  35  per  cent  of  the  largest  hospitals  in  the 
country  responded  to  the  survey,  it  is  felt  that  valid 
generalizations  are  warranted. 

Plan  of  Organization  of  Study 

Chapter  II  of  this  study  will  be  devoted  to  a  histori- 
cal review  of  the  major  contributions  leading  to  the  develop- 
ment of  present  practices  in  job  evaluation.  A  review  of 
the  evolution  of  job  evaluation  will  serve  to  place  succed- 
ing  evaluative  comments  in  proper  perspective.  The  period 
covered  is  from  the  turn  of  the  century,  vftien  job  evaluation 
was  in  its  formative  stages,  through  the  early  forties  and 
the  successful  attempts  by  Lawshe  and  others  to  elevate  the 
status  of  job  evaluation  through  the  development  of  more 
simplified  and  reliable  systems,  to  the  contemporary  studies 
of  evaluation  techniques.  This  chapter  will  seek  to  establish 
the  criteria  by  vAiich  actual  hospital  practice  will  be  judged. 


Succeeding  chapters  are  based  largely  \xpon  the  results 
o£  a  sumrey  of  the  practices  of  hospitals  In  the  use  of  Job 
evaluation  plans.   This  survey,  which  Is  described  In  more 
detail  In  Chapter  III,  was  made  by  visiting  60  hospitals  In 
seven  states  amd  the  District  of  Columbia  and  through  a 
questionnaire  mailed  to  approximately  800  hospitals  through- 
out the  country.   The  survey  attempted  to  determine  the  use 
hospitals  have  made  of  job  evaluation  and  the  extent  to  Which 
hospitals  have  undertaken  to  incorporate  the  techniques  of 
validation,  simplification  and  reliability  determination  In 
their  Job  evaluation  plans.   Chapter  III  outlines  the  method- 
ology employed  In  undertaking  the  survey  and  records  the  com- 
plete results  of  both  the  personal  visits  and  mailed 
questionnaire. 

Chapter  IV  Is  devoted  principally  to  a  discussion  of 
the  major  components  necessary  In  a  hospital  job  evaluation 
program.   Based  upon  Information  drawn  from  personal  contacts 
with  hospital  administrators  and  personnel  directors,  as  well 
as  from  survey  results,  a  general  plan  for  evaluating  hospital 
jobs  Is  proposed.   Since  Individual  hosplteuLs  engage  In  essen- 
tially the  S2une  functional  activities  and  since  the  problems 
relating  to  job  Interrelationships  within  the  hospital  are 
similar:,  development  of  such  a  plan  Is  realistic.   This 
chapter  draws  heavily  upon  the  actvial  survey  In  developing 


10 
such  individual  topics  ast   (a)  administrative  decisions  in 
establishing  Job  evaluation  in  the  hospital,  (b)  preliminary 
planning  and   development  of  the  evaluation  program;  (c)  or- 
gtmizing  and  inplementing  the  project,  and  (d)  maintaining 
control  over  the  newly  estjiblished  plan. 


CHAPTER  II 
THE  EVOLUTION  OP  JOB  EVALUATION 
A  HISTORICAL  PERSPECTIVE 


Early  Attempts  at  Development  zmd  Use  of  Job  Evaluation 
as  a  Tool  In  Wage  Administration 

Statement  of  the  problem  of  equitable  wage  determination 


Job  evaluation  is  not  new.   There  has  always  been  an 
informal  rating  of  Jobs  even  though  the  differentiation  might 
have  been  nothing  more  thzm  a  recognition  of  the  distinction 
between  the  skilled  craftsman  and  the  common  laborer.   How- 
ever, with  the  birth  of  the  Industrial  Revolution  and  its 
concept  of  mass  production,  the  historical  craft  wage  struc- 
ture became  obsolete.   The  development  of  many  new  and  spe- 
cialized skills  resulting  from  the  division  of  labor  and  the 
introduction,  for  the  first  time,  of  many  new  jobs  with  no 
traditional  rate  structure  associated  with  them  necessitated 
the  institution  of  more  analytical  job  rating  techniques. 
Acceptable  means  of  evaliiating  jobs  on  a  relative  basis  were 
slow  in  developing.   However,  a  new  memagement  technique  is 
seldom  contrived  instantaneously,  rather  it  tends  to  evolve 

11 
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with  much  trial  and  error  over  a  period  of  time.   So  it  was 
with  Job  evaluation.   The  growing  complexity  of  the  industrial 
situation  compelled  management  to  direct  its  attention  to  the 
problem  of  achieving  a  more  rational  approach  to  ascertaining 
Job  requirements  and  relationships. 

Laying  the  groundwork  for  systematic  job  measurement 

Of  the  early  pioneers  in  the  field  of  management,  per- 
haps Frederick  W.  Taylor  contributed  more  toward  the  develop- 
ment of  an  analytical  approach  to  the  Job  than  any  other  per- 
son. Although  he  did  not  specifically  discuss  the  idea  of 
job  evaluation  as  such,  he  "is  credited  as  being  a  pioneer  in 
the  job  evaluation  movement."   Taylor  and  his  system  of  sci- 
entific management  introduced  the  principle  of  determining 
wages  by  analysis  of  the  work  to  be  acccmiplished.   Primarily, 
the  analysis  consisted  of  a  sequential  listing  of  the  elements 
needed  for  production  and  the  cunount  of  time  necessary  for 
each  element  or  step  in  order  that  a  standard  time  for  the 
production  of  a  single  unit  might  be  developed.  Although 
Taylor  and  his  contemporaries  seemed  to  be  more  interested  in 
the  development  of  more  efficient  techniques  of  production 


Charles  W.  Brennan,  Wage  Administration  (Homewood, 
Illinois:   Richard  D.  Irwin,  Inc.,  1959),  p.  54. 
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and  reduction  in  unit  costs,  "his  first  premise  was  that  no 
wage  plcm  was  equitable  either  to  men  or  to  management  unless 
it  was  based  upon  accurate  knowledge."   Job  knowledge  is,  of 
course,  fundamental  to  the  establishment  of  amy  system  of 
evaluating  jobs  for  purposes  of  equitable  wage  apportionment. 
Taylor,  himself,  in  cognizance  of  job  variance  and   the  need 
for  proper  job  classification  stateds   "Maximum  prosperity 
for  each  employee  means  not  only  higher  wages  tham  are  usu- 
ally received  by  men  of  his  class,  but,  of  more  in^ortsmce,  it 
also  means  the  development  of  each  man  to  his  state  of  meucimum 
efficiency,  so  that  he  may  be  able  to  do. ..the  highest  grade 
of  work  for  v*iich  his  natural  abilities  fit  him,  and  it 
further  means  giving  him. ..this  class  of  work  to  do,"*  Com- 
plementing his  recognition  of  fundamental  differences  in  work 
classifications,  Taylor  apparently  comprehended  management's 
responsibility  in  establishing  necessary  requisites  for  such 
classes.  Filipetti,  in  discussing  this  facet  of  Taylor's 
work,  contended  that  "the  important  or  fundamental  element 
beneath  the  case  is  that  emphasis  was  placed  upon  the  fact 


n»illiara  R.  Spriegel  and  Richard  H.  Lansburgh, 
Industrial  Management  (5th  ed. ;  New  York:   John  Wiley  zmd 
sons.  Inc.,  1955),  p.  26. 

^Frederick  W.  Taylor,  The  Principles  of  Scientific 
Management  (New  York*  Haxrper  and  Brothers,  1911),  p.  9. 


14 
that  different  jobs  require  different  qualities. . .and  that 
it  is  the  function  of  management  to  determine  these  job  re- 
quirements. . .  • 

There  seems  to  be  little  question  that  the  estab- 
lishment of  a  system  of  wages  by  analysis  of  the  vork  per- 
formed vas  at  least  a  step  forward  from  the  establishment  of 
wages  solely  by  fiat,  individual  bargaining  or  custom.  Under 
such  conditions  management  occupied  a  position  of  economic 
advantage.   There  was,  however,  recognition  that  Taylor  had 
no  more  than  scratched  the  surface  of  the  wage  problem.  Much 
remained  to  be  acccnnplished  in  the  area  of  equitable  wage 
administration.   In  1915,  Robert  F.  Hoxie,  Professor  of  Polit- 
ical Economy  at  the  University  of  Chicago,  conducted  a  stu^ 
of  shops  employing  the  concept  of  scientific  management  for 
the  United  States  Commission  on  Industrial  Relations.   Hoxie 
criticized  the  scientific  approach  to  establishing  the  base 
rate  as  follows a 

If  it  is  to  be  scientific  and  just  according 
to  our  commonly  accepted  standards  of  judgment 
...the  wage  must  reward  all  workers  in  exact 
proportion  to  the  skill  and  energy  which  they 
expend. . . .Viewed  in  this  light,  one  will  seek 
in  vain  for  euiy  scientific  methods  devised  or 


^George  Pilipetti,  Industrial  Management  in  Transi- 
tion (Rev.  ed. ;  Homewood,  Illinoist   Richard  D.  Irwin,  1953) , 
pp.  22-23. 
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employed  by  scientific  mcuiagement  for  the 
determination  of  the  base  rate.... It  was  sug- 
gested by  some  that  the  relative  skill  and 
energy  employed  in  closely  allied  trades 
could  be  determined  by  comparative  elementary 
analysis  of  the  movements  involved.  But  those 
v>ho  held  to  this  view  were  forced  to  admit 
that  where  skill  is  a  vital  factor  this  method 
breaks  down,  and  there  is  no  scientific  mode  of 
ccmiparison  between  different  trades  where  the 
expenditure  of  effort  differs  qualitatively.^ 

The  scientific  approach  to  the  wage  problem,  as  out- 
lined by  Taylor,  was  still  primarily  concerned  with  a  more 
systematic  measure  of  the  quantitative  aspects  of  the  job* 
This  was  an  important  stride  forward;  however,  there  remained 
the  problem  of  measuring  the  more  qualitative  facets  of  the 
Job.  Edward  D.  Jones,  Professor  of  Commerce  and  Industry  at 
the  University  of  Michigan,  recognized  the  value  of  the  qual- 
itative factors  in  euiy  attempt  at  establishing  a  system  for 
evaluating  jobs  as  a  prerequisite  to  an  equitable  solution  of 
the  wage  problem.  As  early  as  1916  he  suggested: 

There  is  still  another  reason  vdiy  the  labor 
market  achieves  only  a  bungling  approximation 
to  a  true  equilibrivmi,  and  this  is  that  in  any 
specific  case  the  exact  labor  capacity  offered 
is  lancertain. .  .there  is  little  knowledge  as  to 
neatness,  accuracy,  dexterity,  speed,  and  de- 
pendability; as  to  education,  general  and  voca- 
tional, and  experience  in  the  craft. .. .Every- 
where  there  is  lack  of  accurate  calculation  of 


Robert  F.  Hoxie,  Scientific  Management  and  Labor 
(New  York:  D.  Appleton  and  Company,  1921).  p.  63. 
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these  essential  f actor s>  and  lacik  of  standardi- 
zation of  them.   With  such  a  mass  of  Indeter- 
minate elements,  the  wage  setting  process  can 
hardly  be  other  than  a  wrangle. .. .Because  of 
such  conditions  great  inequalities  in  wage 
rates  exist  without  adequate  reason;  neither 
party  to  a  wage  transaction  can  be  sure  it  has 
received  Justice. .. .In  the  interest  of  a  fair 
wage  it  is  greatly  to  be  desired  that  science 
should  be  applied  to  the  measurement  of  these 
indeterminate  or  crudely  calculated  factors 
of  the  labor  problem. 

Professor  Jones*  accurate  statement  of  the  need  for 
more  specific  measurement  of  the  more  intangible  facets  of 
the  Job  seemed  to  be  prophetic  in  natiare.  However,  his 
writing  does  not  give  any  indication  of  the  development  of 
a  plan  for  measurement  or  use  of  the  factors  \^iich  he  con- 
sidered as  important  in  constructing  a  stable  wage  plan. 

Contributions  to  a  more  systematic  means  of  job  measurement 

Even  though  Frederick  Taylor  and  his  contemporaries 
brought  to  light  the  problem  of  inadequate  Job  rating  and 
laid  the  groundwork  for  a  more  rational  approach  to  the 
problem,  major  progress  was  slow  in  materializing.  Neverthe- 
less, evidence  of  procedural  change  became  apparent  as  early 
as  1910.   The  principal  areas  of  advancement  in  Job  evaluaticn 


Edward  D.  Jones,  The  Administration  of  Industrial 
Enterprises  (Italics  supplied.)  (New  Yorkx   Longmans,  Green 
and  Company,  1916) ,  pp.  226-228. 
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techniques  will  be  discussed  under  the  following  topical 
headings: 

1.  Development  of  more  complete  Job 
information. 

2.  Use  of  committees  in  the  evaltiation 
process. 

3.  Use  of  weighted  separate  Job&ctors. 

4.  Use  of  key  or  benchmark  jobs. 

5.  Development  of  a  simplified  system  of 
evaluating  Jobs. 

6.  Studies  in  reliability  of  the  evaluation 
plan. 

7.  Studies  in  validity  of  the  evaluation 
plan. 

Development  of  more  complete  job  information.  One 
of  the  more  notewojrthy  examples  of  early  development  in  the 
area  of  Job  evaluation  was  the  work  accomplished  by  the  Chi- 
cago Civil  Service  Commission  in  requiring  more  adequate  Job 
studies  and  descriptions.   As  early  as  1910  the  Commission 


•'•For  example,  the  Commission  required  "detailed  facts 
with  regard  to  the  duties  attached  to  each  individual  posi- 
tion with  regard  to  its  place  in  the  organization  unit  in 
vAiich  it  occurs."   In  addition,  written  statements  were  re- 
quired stating  the  minimxira  qualifications  necessary  to  suc- 
cessfully perform  the  duties  of  the  position.  Also,  standard- 
ized position  titles  suggestive  of  the  duties  attached  to  the 
positions  were  established.  For  a  complete  report  of  the 
Commission's  total  approach  to  Job  studies  see  Fred  Telford, 
"The  Classification  and  Salary  Standardization  Movement  in  the 
Public  Service,"  Annals  of  the  American  ftcademy  of  Political 
and  social  Science,  CXIII  (May,  1924),  p.  207. 
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had  developed  a  £oinnal  plan  for  classifying  positions  in 
various  units  of  the  city  government.   Although  the  program 
was  somev^at  subjective  in  natxire,  it  represented  a  vast  im- 
provement over  the  complete  lack  of  standardization  prior  to 
its  inception.  According  to  Lytle,  prior  to  the  development 
of  the  Chicago  Civil  Service  Ccnranission's  approach  to  Job 
analysis,  primary  emphasis  was  placed  on  improvement  of  job 
methods  through  job  study.   The  term  job  study  or  job  analysis 
as  used  by  industrial  engineers  was  not  adequately  differen- 
tiated from  the  term  as  used  at  a  later  period  by  personnel 
men.   Subsequent  to  the  Commission's  establishment  of  job 
amalysis  as  a  determination  of  the  component  elements  of  a 
job,  a  great  deal  of  attention  was  focused  on  this  new  usage 
of  the  Job  study. 

The  need  for  in^rovement  in  the  area  of  evaluating 
jobs  was  exposed  rather  une:qpectedly.  Earlier  the  Commission 
was  attempting  to  bring  about  improvements  in  areas  other  than 
job  evaluation  in  several  city  departments.   To  its  dismay,  it 
discovered  the  impossibility  of  accomplishing  desired  action 
due  to  the  fact  that  job  titles  in  use  were  frequently  not 


Charles  P.  Messick,  "Development  and  Administration 
of  Classification  and  Compensation  Plans  in  New  Jersey," 
Annals  of  the  American  Aademy  of  Political  and  Social  Science, 
CXIII  (May,  1924) ,  p.  246. 
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descriptive  and  in  many  cases  were  actually  misleading.   Fur- 
ther checking  on  the  situation  revealed  that  many  employees 
did  not  possess  the  qualifications  necessary  for  performing 
the  duties  of  the  positions  they  were  holding  and  that  com- 
pensation in  many  cases  bore  little  or  no  relationship  either 
to  the  work  performed  or  the  title  of  the  job. 

The  Commission  took  action  \*iich  resulted  in  what  one 
author  flatly  described  as  "the  first  duties  classification 
and  the  first  standardized  compensation  plan  based  on  a 
duties  classification  in  this  country.  "-^  According  to 
Charles  Lytle,  the  major  contribution  made  by  the  Commission's 
work  lay  in  the  area  of  more  complete  job  information.   He 
stated:   "Modern  job  analysis  was  started  in  1909  by  a  re- 
quirement of  the  Civil  Service  Commission  of  Chicago  and  the 
subsequent  work  of  the  Commonwealth  Edison  Company  of  that 
city."^  Lytle  further  expressed  the  opinion  that  "inspira- 
tion for  this  step  came  from  Taylor's  practices,  his  further 
specialization  of  jobs  and  his  science  of  work  studies."^ 


^Telford,  op.  cit.,  p.  207. 

^Charles  W.  Lytle,  Job  Evaluation  Methods  (2nd  ed. ; 
New  York:  Ronald  Press  Company,  1954),  p.  11. 

3  Ibid. 
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Use  of  committees  in  evaluating  jobs.   One  of  the 
earliest  references  to  the  use  of  a  committee  In  rating  and 
classifying  jobs  was  made  by  w.  D.  Steams,  secretary  of 
the  Occupations  and  Rates  Committee  of  the  Westlnghouse 
Electric  and  Manufacturing  Company,  in  1919,   The  evalua- 
tion process  as  developed  was  single.   It  represented  nothing 
more  than  a  ranking  and  classification  of  Jobs  based  on  sev- 
eral factors.   However,  the  importance  of  committee  action  was 
clearly  stipulated.   The  committee  on  Occupations  and  Rates 
was  responsible  for  seeing  that  jobs  were  properly  classified 
and  proper  wage  rates  set.   In  the  actual  classification 
process,  jobs  were  sorted  into  one  of  five  groups  represent- 
ing the  different  classifications.   If  there  was  any  doubt 
about  a  particular  classification,  the  card  was  set  aside  for 
further  consideration  by  the  committee.   In  the  opinion  of 
Stearns,  it  was  self-evident  that  group  judgment  was  superior 
to  individual  classification,  especially  where  difficulty 
might  be  encountered  in  properly  rating  a  particular  job. 

Even  though  Steaims  had  earlier  made  use  of  the  com- 
mittee in  classifying  jobs«  Eugene  J.  Benge  was  one  of  the 
first  to  call  particular  attention  to  the  value  of  using  a 


^W.  D.  Stearns,  "Placing  the  Right  Man  on  the  Right 
Job,"  Machinery,  XXVI,  No.  2  (October,  1919),  p.  38. 
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committee  for  rating  purposes.   From  his  vnritings  it  vas 
evident  to  Benge  that  the  use  of  a  job  evaluation  consnlttee 
and  its  "pooled"  judgment  was  superior  to  the  generally 
accepted  idea  of  individual  rating  of  job  worth.   It  was  his 
opinion  that  minor  variations  resulting  from  individual  dif- 
ferences might  be  modified  by  a  simple  averaging  process  in 
terms  of  both  individtial  scores  and  time  and  that  the  com- 
mittee with  its  collective  judgment  was  indlspensible  to  the 
proper  functioning  of  an  evaluation  plan.   Indeed  the  com- 
mittee was  an  important  step  in  the  right  direction  in  help- 
ing to  modify  the  vicissitudes  of  human  judgment.   Hov»ever, 
with  the  development  of  validity  and  reliability  checks  the 
committee  was  no  longer  necessary,  at  least  as  a  check  on 
individual  judgment.   Under  a  properly  validated  system  con- 
sistently used  in  the  proper  manner,  individual  or  collective 
judgment  is  of  no  consequence  in  trying  to  develop  a  "correct" 
plan.   Even  so,  the  committee  is  still  frequently  used  as  a 
means  of  permitting  supervisory  participation  in  an  effort  to 
gstin  support  for  the  job  evaluation  program  as  well  as  to 
assist  in  securing  valid  ratings  through  information  gained 
by  committee  investigation  euid  discussion. 


•^Eugene  J.  Benge,  "Gauging  the  Job*s  Worth,  "  Part  I, 
Industrial  Relations,  III  (February,  1932),  p.  66. 


22 

Use  of  weighted  separate  characteristics.   Based  on  a 
survey  of  literature  in  the  field  of  management*  it  is  evi- 
dent that  several  types  of  subjective  ranking  and  classifica- 
tion plauis  for  evaluating  the  relative  worth  of  Jobs  had 
been  developed  and  a  considerable  amount  of  thought  had  been 
given  by  writers  in  the  field  of  management  to  the  problem 
of  Job  evaluation  prior  to  1925.  However,  Merrill  Lott  is 
generally  credited  with  the  creation  and  promulgation  of  the 
first  thorough-going  plan   for  evaluating  Jobs  by  weighting 
separate  factors.   In  1925,  he  first  published  a  description 

of  the  method  involved  in  the  use  of  his  point  rating  system 

2 

in  the  Journal  of  Manufacturing  Industries.   Because  of  its 

wide  acclaim  by  readers  of  the  article,  he  subsequently  pub- 
lished the  material  in  more  detail  in  book  form.  Comparison 
of  his  original  system  of  evaluating  Jobs  with  siibsequent 
point  systems  indicates  that  the  majority  of  the  latter  plans 
partake  of  the  basic  elements  of  the  original,  although  some 
modifications  have  taken  place.   The  work  accon^lished  by 
Lott  opened  the  door  to  general  development  and  use  of  Job 
evaluation  as  a  means  of  eliminating  or  at  least  minimizing 
many  existing  wage  and  salary  difficulties. 


^Lytle,  op.  cit.,  p.  57. 

^Merrill  R.  Lott,  Wage  Scales  and  Job  Evaluation 
(New  York J  The  Ronald  Press  Company,  1926),  p.  vii. 
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Since  previous  evaluation  systems  had  considered  both 
the  development  of  work  requirements  through  job  analysis  and 
specifications  and  a  general  analysis  of  factors  Influencing 
the  worth  of  the  job,  the  primary  contribution  of  Lott  was 
his  recognition  of  the  degree  of  difference  between  factors 
and  the  establishment  of  weights  to  distinguish  between  the 
relative  Importance  of  the  various  factors. 

Prior  to  Lott's  time  the  straight  point  method  was 
the  only  type  of  point  plan  In  usage.   The  Idea  that  some 
factors  were  much  more  Important  than   others  was  con^letely 
Ignored.   Consequently,  In  the  final  analysis,  some  factors 
were  overvalued  vAille  others  were  undervalued.   Lott's 
weighted  point  plan  sought  to  remed/  this  deficiency.   In 
addition,  Lott's  plan  established  different  degree  values  as 
a  raeams  of  differentiating  between  different  levels  or 
degrees  of  each  factor.   The  straight  point  plan  also  estab- 
lished degrees;  however,  no  attempt  was  made  to  adequately 
differentiate  between  the  Initial  degree  and  the  top  degree. 
For  example,  degree  nvmiber  one  was  normally  assigned  a  value 
of  zero  or  one  and  degree  five  a  value  of  four  or  five.   Ob- 
viously, \^ere  a  great  difference  existed  between  levels  of 
job  difficulty,  the  point  difference  between  the  first  degree 


•'•Benge,  op.  clt. ,  Part  II,  p.  117. 
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and  the  top  degree  was  not  adequate  to  properly  differentiate 
job  values.   Such  subjectiveness  in  both  factors  and  degrees 
led  to  an  excessive  amount  of  arbitrariness  in  rating  Jobs. 
Lott's  decision  to  weight  factors  according  to  their  relative 
importamce  and  to  differentiate  degree  values  was  a  long 
stride  foxrward  in  the  development  of  accurate  Job  rating. 
Although  Lott  did  not  give  evidence  of  recognizing  the  fact, 
his  improvement  in  the  point  rating  plan  made  possible  the 
later  development  of  the  concept  of  validity.   Since  factors 
do  differ  in  importance  as  they  contribute  to  job  worth,  in 
order  to  assure  the  validity  of  any  petit  plan  of  evaluation, 
cognizance  must  be  taken  of  this  difference.   Thus  Lott*s 
major  contribution  in  the  form  of  separate  weighted  char- 
acteristics was  a  necessa3Y  forerunner  to  developing  a  valid 
job  evaluation  system. 

Use  of  key  or  bench-mark  jobs  in  rating.   In  1926, 
Eugene  J.  Benge,  under  the  sponsorship  of  Thomas  E.  Mitten 
of  the  Philadelphia  Rapid  Transit  Company  developed  an  eval- 
uation plan  \^ich  was  destined  to  beconoe  the  forerxuiner  of 
the  factor  comparison  system  of  evaluating  jobs.   The 


Eugene  J.  Benge,  Seunuel  L.  H.  Burk,  and  Edward  N. 
Hay,  Manual  of  Job  Evaluation  (New  Yorkj   Harper  and  Bros., 
1941) ,  pp.  ix-x. 
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principal  difference  between  Benge's  plan  and  present  day 

factor  comparison  plans  lies  in  the  development  of  v/age  rates 
for  key  jobs.   In  the  earlier  plan,  internal  rates  for  key 
jobs  \*iich  were  agreed  upon  as  fair  by  the  evaluation  com- 
mittee were  apportioned  among  the  factors.  At  present,  ex- 
ternal going  rates  for  key  jobs  are  apportioned  among 
factors.  The  difference  is  significant  since  the  latter 
system  at  least  offers  an  independent  frame  of  reference 
upon  v^ich  the  company's  wage  scale  is  based. 

In  a  series  of  articles  entitled  "Gauging  the  Job's 
Worth, "  Benge  set  forth  the  general  principles  involved  in 
his  establishment  of  an  effective  program  of  job  evaluation 
based  on  a  comparison  of  job  factors.   One  of  the  most  im- 
portant facets  of  the  new  plan  involved  the  use  of  key  or 
bench-mark  jobs  against  Which  less  well-known  jobs  in  the 
orgemization  could  be  compared.   Lytle  described  this  use  of 

multiple  key  jobs  for  comparison  purposes  as  the  "surest 

2 
virture"  of  Benge 's  plan.   In  his  original  plan,  ten  bench- 
mark jobs,  common  to  several  departments,  were  selected  for 


The  principal  aspects  of  the  following  discussion 
were  drawn  from  Benge 's  article  "Gauging  the  Job's  Worth" 
Parts  I,  II  and  III,  Industrial  Relations,  III  (February, 
March  and  April,  1932),  pp.  66-69,  117-120  and  177-180, 
respectively. 

^Lytle,  op.  cit. ,  p.  42. 
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Intensive  amalysis;  however,  so  much  emphasis  vas  placed 
upon  these  key  or  bench-mark  jobs  as  criteria  for  job  com- 
parison that  Benge  later  decided  to  Increase  the  number  from 
the  original  ten  to  between  fifteen  zuid  twenty- five. 

These  key  jobs  as  developed  by  Benge  were  essentially 
Internal  bench-mark  jobs  and  therefore  did  not  carry  the  same 
connotation  that  Is  placed  upon  the  concept  of  key  jobs  at 

present.  Many  of  the  characteristics  required  of  a  key  job 

2 

were  the  same;  however,  the  most  Important  requirement,  that 

there  be  no  under  or  over  supply  of  such  jobs  in  the  labor 
market  in  question,  was  missing  in  the  original  interpreta- 
tion of  what  constituted  a  key  job.   This  particular  require- 
ment is  necessary  if  the  key  jobs  selected  are  to  reflect  the 
Inherent  demands  of  the  labor  market  in  question  in  the  devel- 
opment of  an  Internally  equitable  wage  plan. 

Although  Benge,  in  his  concept  of  key  jobs,  failed 
to  recognize  this  most  important  fiinction  (that  of  using  key 
jobs  as  external  validating  criteria),  his  idea  at  least 
pointed  up  the  usefulness  of  key  jobs  in  inter- job  comparison 
and  subsequent  development  of  an  acceptable  wage  plan. 


•'■Benge,  Burk  and  Hay,  op.  cit. .  p.  104. 

^See  Chapter  IV  for  a  complete  description  of  the 
necessary   v-haracteri sties  of  a  key  job. 
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Development  of  a  simplified  system  of  evaluating  jobs. 
Beginning  with  Lott's  point  plan,  most  of  the  formal  evalua- 
tion systems  made  use  of  from  fifteen  to  twenty-five  factors 
in  rating  jobs.  As  a  matter  of  fact,  as  many  as  forty-two 
factors  were  found  in  use  in  some  of  the  early  plans.   Con- 
trary to  this  general  trend,  Eugene  J.  Benge  established  his 
factor  comparison  plan  for  evaluating  Jobs  using  only  five 
separate  factors.^   In  selecting  factors  for  comparison  pur- 
poses, Benge  and  his  staff  of  job  analysts  secured  job 
descriptions  for  several  hundred  jobs  throughout  the  plant. 
Analyzing  these  descriptions,  the  group  was  able  to  observe 
over  fifty  different  factors  not  all  of  v^ich  were  present 
in  all  jobs,  however.   Further  stud^  revealed  that  all  of 
these  factors  could  be  classified  vmder  one  or  the  other  of 
five  major  characteristics;  mental  effort,  skill,  physical 
effort,  responsibility  and  working  conditions.   These  factors 
became  the  basic  comparison  items  upon  v^ich  the  vAiole  system 
functioned.   Benge  was  one  of  the  first  to  recognize  that  a 
reduced  number  of  common  factors  could  measure  job  worth  as 


^John  W.  Riegel,  Wage  Deterroination  (Ann  Arbor: 
Bureau  of  Industrial  Relations,  University  of  Michigem,  1937), 
p.  87. 

^Bugene  J.  Benge,  Job  Evaluation  and  Merit  Rating 
National  Foreman's  Institute,  Inc.  (Deep  River,  Connecticut, 
1941),  p.  21. 
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effectively  as  a  much  larger  number.   This  emphasis  upon  a 
very  few  factors  as  accounting  for  a  major  portion  of  Job 
varlzmce  was  In  keeping  with  later  research  findings.   Thus 
Benge  made  a  definite  contribution  In  terms  of  simplifying 
the  Job  evaluation  program  which.  In  turn,  led  to  sxibstantlal 
savings  In  cost,  time  and   effort. 

At  least  two  other  early  authors  of  Job  evaluation 
plans  followed  the  lead  of  Benge  In  the  establishment  of 
evaluation  systems  using  relatively  few  rating  factors.   In 
1932,  D.  W.  Weed,  developed  a  Job  evaluation  plan  using  only 
six  compensatory  factors.   Shortly  thereafter,  A.  w,  Bass,  Jr. 
created  a  Job  evaluation  plan  using  a  highly  restricted 
number  of  factors.   It  was  the  opinion  of  Base   that  there 
were  only  three  basic  factors  contributing  to  Job  values: 
skill,  personal  characteristics  and  working  conditions.   Each 
Job  was  rated  In  comparison  with  other  Jobs  on  these  three 
basic  factors  only.   These  Items  constitute  essentially  the 
same  factors  that  C.  H.  Lawshe  extracted  from  a  much  larger 
list  of  factors  as  accounting  for  virtually  all  of  Job  var- 
iance.  Each  of  the  above  authors  logically  deduced  that 
equal  results  could  be  obtained  with  the  use  of  few  rather 
than  mamy  factors.   Even  so,  the  decision  to  use  a  reduced 
number  of  factors  was  sc»newhat  subjective  and  arbitrary. 
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Little  more  than  fifteen  years  had  elapsed  since 
Merrill  Lott  developed  the  first  thoroughgoing  plem  for 
quantitatively  evaluating  jobs.   Several  different  methods 
and  approaches  to  the  problem  of  evaluating  jobs  had  been 
developed  in  the  intervening  years;  however,  the  rapidity 
with  vAiich  job  evaluation  emerged  as  a  full-blown  tool  of 
management  left  little  time  for  needed  research.  As  late  as 
1950,  C.  H.  Lawshe,  Jr.  of  Purdue  University,  conceded  that 
"insofar  as  extensive  use  and  acceptamce  are  concerned,  job 
evaluation  generally,  eind  point  systems  specifically,  are 
relatively  new.  Much  of  our  experience  in  their  use  has  been 
strictly  of  the  trial-emd-error  variety. .. .Until  recent  years 
there  has  been  little  true  research  in  job  evaluation."   It 
became  apparent  that  without  a  more  objective  appraisal  of 
system  development,  a  situation  might  well  evolve  in  vAiich 
certain  rather  complicated  and  involved  evaluating  systems 
dominating  the  scene  might  be  assumed  to  be  more  "scientific," 
and  therefore  better,  solely  on  the  basis  of  this  complexity. 
Realization  of  this  possibility,  coupled  with  Dr.  Joseph 
Tiffin's  investigations  at  Purdue  in  the  area  of  merit  rating 


Ijoseph  M.  Dooher  and  Vivenne  Marquis  (ed.).  The  AMA 
Handbook  of  Wage  and  Salary  Administration  (New  York: 
American  Management  Association,  1950),  p.  387. 
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prompted  Lawshe  and  his  associates  to  undertake  a  program  o£ 
research  Into  the  possibility  of  developing  an  abbreviated 
system  for  measuring  Job  worth. 

As  Lawshe  studied  early  Job  evaluation  plans  it  be- 
ceune  apparent  that  use  of  such  a  large  n\iinber  of  factors  not 
only  increased  the  time  consumed  in  rating  Jobs,  thereby 
raising  costs,  but  also  contributed  to  complexity  of  the 
system,  thereby  hampering  understanding  smd  acceptance.   Re- 
search commenced  in  an   effort  to  deteinnine  whether  a  more 
simplified  system  of  Job  evaluation  was  practical.   It  did 
not  take  researchers  long  to  ascertain  the  fact  that  certain 
items  tended  to  vary  together.  As  an  example.  Jobs  that  were 
rated  high  on  the  factor  "education"  tended  to  be  rated  high 
on  "experience,"   Jobs  vdiich  were  rated  low  on  the  one  tended 
to  be  rated  low  on  the  other.   Because  of  this  high  correla- 
tion between  many  of  the  items,  the  hypothesis  was  set  forth 

that  some  few  primary  factors  existed  vihich  were  common  to 

2 

each  of  the  items,  but  \^ich  were  independent  of  one  another. 

The  problem  was  to  isolate  these  primary  factors  emd  identify 
them. 


•^Infoxrmation  contained  in  a  letter  from  C.  H.  Lawshe, 
Jr.  to  the  writer,  dated  July  29,  1960. 

2c.  H.  Lawshe,  Jr.,  "Toward  Simplified  Job  Evalua- 
tion," Personnel,  XXII,  No.  3  (November  1945),  pp.  155-157, 
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At  this  point,  Lawshe  tvirned  to  a  statistical  technique, 
already  in  use  in  psychological  research,  commonly  knovm  as 
"factor  analysis."   Previous  investigations  had  proven  con- 
clusively that,  as  far  as  tests  were  concerned,  "no  test 
constituted  an  unadulterated  measure  of  any  primary  ability 
or  trait"  since  all  tests  "sure  contaminated  to  some  extent 
with  variances  in  other  primary  traits  or  characteristics." 
It  was  Lawshe 's  opinion  that  much  the  same  clrcvmistance 
surrounded  the  use  of  a  large  nuinber  of  job  rating  items. 
Many  items  were  apparently  not  mutually  exclusive  in  measur- 
ing the  trait  they  purported  to  measure.   "Factor  analysis" 
was  advamced  as  a  meams  of  ascertaining  which  variables 
tended  to  fluctuate  together  in  measuring  the  same  basic 
trait.   Lawshe  concluded  that  essentially  the  same  technique 
could  be  applied  to  an  amalysis  of  factors  used  in  rating  jobs 
to  determine  \*xether  certain  items  did  tend  to  "cluster"  or 
vary  together  thereby  meastiring  the  same  basic  job  element. 
Subsequent  research  proved  the  soundness  of  his  assumption. 

The  logic  of  this  concept,  at  least  from  the  stand- 
point of  methodology,  was  sound.   If  it  could  be  demonstrated 
that  certain  items  tend  to  "cluster"  with  a  high  coefficient 


^J.    P.    Guilford,    F\indcunental   Statistics   in  Psychology 
and  Education    (New  York:      McGraw-Hill  Book  Co.    1942),    p.    285. 
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of  correlation  between  item  ratings,  then  the  value  of  any 
item  in  the  cluster  could  be  computed  from  the  value  of  any 
other  item.   If  a  high  degree  of  correlation  existed  between 
several  of  the  individual  items,  it  could  further  be  assumed 
that  only  a  relatively  small  number  of  primary  factors  or 
"clusters'*  existed  and  that  the  actual  items  making  up  the 
individual  "clusters"  represented  various  shadings  of  the 
primary  factor.   Provided  these  primary  factors  could  be  iso- 
lated, it  would  be  possible  to  evaluate  the  job,  using  only 
three  or,  at  most,  four  factors  instead  of  ten  or  fifteen. 
The  additional  amount  of  time  and  effort  necessitated  by  the 
use  of  the  larger  number  of  rating  factors  could  be  consider- 
ably reduced. 

With  these  ideas  in  mind,  Lawshe  and  G.  A.  Satter, 
representing  the  Division  of  Education  cind  Applied  Psychology 
at  Purdue  University,  undertook  in  1943,  a  detailed  statisti- 
cal study  of  the  National  Electrical  Manufacturers  Associa- 
tion's point  system  of  job  evaluation  as  applied  in  three  sep- 
arate industrial  plsmts.   The  avowed  objectives  of  this  stu  dy 
were  to  try  to  identify  the  primary  factors  operating  in  each 
plant,  and  to  ascertain  the  extent  of  item  "clustering" 
around  these  primary  factors. 


•'■C.  H.  Lawshe,  Jr.  and  G.  A.  Satter,  "Studies  in  Job 
Evaluation  I:  Factor  Analysis  of  Point  Ratings  for  Hourly- 
Paid  Jobs  in  Three  Industrial  Plants,  Journal  of  Applied 
Psychology,  XXVIII,  No.  3  (June  1944),  pp.  184-198. 
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Factor  analysis  was  applied  to  the  eleven  factor  NEMA 
plan-^  used  in  each  of  the  three  plants.   Two  primary  factors 
were  extracted  from  plants  A  and  B  eUid  four  from  plant  C. 
In  effect,  it  was  found  that  two  basic  factors  (rather  than 
11)  were  accounting  for  most  of  the  variability  in  total  point 
ratings  in  the  first  two  plants.   Likewise,  four  basic  factors 
(rather  than  11)  were  accoxmting  for  most  of  the  variability 
in  total  point  ratings  in  the  third  plant.   These  results 
were  indeed  significant  in  terms  of  potential  reduction  in 
the  cost  and  effort  involved  in  the  use  of  job  evaluation. 
Furthermore,  the  rating  procedure  was  considerably  simpli- 
fied.  Lawshe's  research  denied  the  premise  that  in  order  to 
adequately  measure  job  worth  in  these  plants,  factors  would 
have  to  be  fractionated  to  include  eleven  individual  items. 

After  the  original  study  was  made,  Lawshe  sought  to 
determine  v^ether  the  abbreviated  system  as  developed  would 
achieve  results  comparable  to  results  originally  achieved 


See  David  W.  Belcher,  Wage  and  Salaay  Administration 
(Englewood  Cliffs,  N.  J. r   Prentice-Hall,  Inc.,  1955),  pp. 
220-221,  for  a  listing  of  the  factors  involved. 

*The  primary  factors  in  plants  A  and  B  were  "skill 
demands'*  and  "job  characteristics-general."   In  plant  C, 
two  additional  primary  factors  were  founds   "Job  character- 
istics-hazardous" and  "attention  demands."   This  fourth 
factor  apparently  arose  frcan  the  great  deal  of  visual  and 
mental  attention  required  in  inspection  and  machine  attend- 
ing in  Plant  C. 
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through  use  of  the  elongated  system.    The  criterion  In  this 
Instance  was  the  number  of  jobs  shifted  In  terms  of  pay 
rates  under  the  abbreviated  system. 

In  order  to  select  Individual  items  from  the  clusters^ 
with  vfliich  to  predict,  the  Wherry-Doollttle  shrinkage  selec- 
tion method  was  applied  cmd  the  first  three  items  were  iden- 
tified for  each  of  the  three  plants.   Using  data  obtained  in 
each  plant,  a  multiple  regression  equation  was  developed  for 
purposes  of  predicting  total  point  ratings  using  the  simpli- 
fied system.   Results  were  surprising.   Of  the  247  jobs, 
vAiose  total  points  were  computed  from  the  estimating  equa- 
tion, 62  per  cent  (153  jobs)  remained  in  the  scune  labor 
grade,  37.2  per  cent  (92  jobs)  were  displaced  by  one  labor 
grade  auid  0.8  per  cent  (2  jobs)  were  displaced  by  two  labor 
grades.   More  importantly,  however,  v^en  the  data  were  fur- 
ther analyzed  on  the  basis  of  number  of  points  deviation 
from  the  original  total  point  rating,  only  seven  jobs  were 
fovmd  to  deviate  from  the  original  rating  by  more  thzm 
twenty-two  points  which  represented  the  range  of  points 


C.  H.  Lawshe,  Jr.,  "Studies  in  Job  Evaluation  lit 
The  Adecjuacy  of  Abbreviated  Point  Ratings  for  Hourly-Paid 
Jobs  in  Three  Industrial  Plants,  *•  Journal  of  Applied  Psy- 
chology, XXIX,  No.  3  (Jvme,  1945),  pp.  177-184. 

2 

"Primary  factors  were  developed  from  item  clustering. 
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within  labor  grades.   Even  this  difference  was  minimized, 
from  the  point  of  view  of  salary,  since  an  overlap  existed 
in  progressive  grades  so  that  the  same  salary  was  applicable 
in  several  grades.  To  all  intents  and  purposes  the  research 
results  had  proven  rather  conclusively  that  a  simplified 
system  was  practical,  at  least  from  the  standpoint  of 
methodology. 

Since  the  original  study  was  based  on  hourly  paid 
Jobs  in  three  industrial  plants,  Lawshe  and  an  associate, 
A.  A.  Male ski,  in  1946,  decided  to  test  the  simplified  sys- 
tem  on  salaried  jobs,"^  The  objectives  were  the  same  as  for 
the  initial  study  and  identical  statisticerl  methods  were 
applied.   Since  the  work  involved  circ\amstzmces  different 
from  those  in  the  plant,  a  different  set  of  items  was  devel- 
oped for  use  in  rating  jobs.   Included  were  several  items, 
such  as  confidential  data,  scope  and  character  of  supervis- 
ion, and  complexity  of  duties,  not  applicable  in  the  orig- 
inal plaui;  however,  as  in  the  original  there  were  eleven 
items  with  varying  degrees  of  complexity.   Practically  the 


•'■C.  H.  Lawshe,  Jr.,  "Studies  in  Job  Evaluation  II, « 
op.  cit.,  pp.  180-181. 

2 

C,  H.  Lawshe,  Jr.  and  A.  A.  Maleski,  "Studies  in  Job 

Evaluation  III:  An  analysis  of  Point  Ratings  for  Salary- 
Paid  Jobs  in  an  Industrial  Plant, "  Journal  of  Applied  Psy- 
cholocrv,  XXX,  No.  2  (April  1946),  pp.  117-128. 
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same  results  occurred.   In  this  Instzmce  three  primary 
factors  were  again  Identified,  namely  skill  demands,  super- 
visory demands  and  Job  characteristics.  As  might  be  expected 
In  Jobs  of  this  nature,  a  heavy  loading  was  found  in  the 
Items  relating  to  necessary  supervision.  As  In  the  three 
original  plants,  the  factor  "skill  demands"  continued  to 
account  for  most  of  the  variance  In  total  points. 

Zn  the  same  year,  two  other  studies  of  the  same 
nature  were  conducted:  the  first,  a  study  of  hourly-paid  Jobs 
In  a  different  plamt  using  a  point  rating  system  different 

from  the  NEMA  system  atnd,  the  second,  an  emalysls  of  the 

2 

factor  ccxnparlson  system  as  It  functioned  In  a  paper  mill. 

As  In  previous  research,  practically  Identical  results  were 
obtained. 

In  each  of  the  aforementioned  research  studies,  a 
multiple  regression  formula  was  developed  and  estimated  total 


^C.  H.  Lawshe,  Jr.  and  S.  L.  Alessl,  "Studies  in  Job 
Evaluation  IV j  Analysis  of  Another  Point  Rating  Scale  for 
Hourly-Paid  Jobs  and  the  Adequacy  of  an  Abbreviated  Scale, " 
Journal  of  Applied  Psychology,  XXX,  No.  4  (August  1946) , 
pp.  310-319. 

^c.  H.  Lawshe,  Jr.  and  R.  F.  Wilson,  "Studies  in  Job 
Evaluation  Vj  An  analysis  of  the  Factor  Comparison  System  As 
it  Functions  in  a  Paper  Mill,"  Journal  of  Applied  Psychology, 
XXX,  No,  5  (October  1946) ,  pp.  426-434. 
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point  values  for  all  Jobs  in  each  organization  were  computed. 
As  in  the  first  study,  results  were  exceptionally  good  in 
terras  of  labor  grade  displacement.   Table  1  sximmarizes  these 
results. 

TABLE  1 

COMPARISON  OF  JOB  LABOR  GRADE  DISPIACEMENT  FOR  SIX 
DIFFERENT  INDUSTRIAL  ORGANIZATIONS 


Plant 

Co,  System 

Type  of  Wage 

Agreement 

A 

B 
C 
A 
D 
E 

NEMA 
NEMA 
NEMA 
NEMA 

System  "X" 
Factor  Comparison 

Hourly 
Hourly 
Hourly 
Salary 
Salary 
Salary 

97%  within  22  points 
91%  within  22  points 
100%  within  22  points 
86%  within  30  points* 
94%  within   5  cents^ 
96%  within   5  cents^ 

Source:   Dooher  auid  Marquis,  op.  cit.,  p.  391. 

*Had  a  salary  grade  range  of  30  points  rather  than 
22  points. 

^id  not  employ  labor  grade  approach  but  conversions 
made  directly  from  points  to  cents  per  hour. 


At  about  the  same  time,  R.  C.  Rogers  of  the  De  Laval 
Steam  Turbine  Company  in  Trenton,  New  Jersey,  examined  two 
other  point  rating  plans  employed  in  a  metal  machining  in- 
dustry (one  for  hourly  paid  jobs  and  the  other  for  salaried 
jobs)  for  purposes  of  determining  the  effectiveness  of  the  two 
systems  as  measuring  instruments.   The  same  statistical 
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approach  was  used  and  essentially  the  same  results  were 
achieved  as  by  Lawshe*s  group.  As  Rogers  stated  the  caset 
"The  results  of  this  study, • .emphasize  the  fact  that  many  of 
the  principles  and  techniques  of  scientific  measurement  have 
been  neglected  in  the  construction  and  evaluation  of  these 
plans.  As  a  result,  many   of  the  elaborate  multifactored 
systems... contain  a  ntunber  of  components  nnhich  could  be 
dropped  from  the  battery  without  sigrificantly  affecting  the 
acciaracy  of  the  final  evaluation." 

Underlying  the  point  and   factor  comparison  systems 
of  Job  evaluation  are  certain  assumptions  vAiich  the  foregoing 
research  results  prove  untenable.   In  the  first  place,  most 
job  evaluation  systems  assume  that  each  factor  or  item  used 
in  the  plan  measures  some  specific  aspect  of  Job  worth  and 
that  each  is  capable  of  independent  evaluation.  Again,  each 
factor  in  the  plan  is  assvuaed  to  be  properly  weighted  in 
terms  of  its  particular  contribution  to  total  worth.   It  was 
clearly  demonstrated  in  each  of  the  research  projects  dis- 
cussed that  numerous  individual  items  were  being  used  in 
rating  Jobs  \^ich  contributed  little  or  nothing  to  the  dis- 
criminating ability  of  the  system.  As  a  matter  of  fact,  in 


R.  C.  Rogers,  "An  Analysis  of  Two  Point  Rating  Job 
Evaluation  Plans, "  Journal  of  Applied  Psychology,  XXX,  No.  2 
(December  1947),  p.  584. 
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certain  cases,  individual  items  were  weighted  rather  heavily 
in  determining  total  job  worth  vihen,  in  effect,  such  items 
were  of  little  or  no  consequence  in  providing  unique  measures. 
Such  an  approach  distorted  the  relative  importance  that  the 
various  items  actually  had  in  determining  the  final  rating 
and,  consequently,  the  salary  structure.   Reliance  on  human 
judgment  in  developing  rating  factors  tended  to  increase  the 
complexity  of  the  system  without  increasing  its  effectiveness. 
In  addition,  the  reliability^  of  job  evaluation  systems  was 
thrown  open  to  question  as  a  result  of  these  studies  since 
it  became  apparent  that  the  minute  fractionation  of  factors 
evidently  made  for  greater  discrepancies  between  raters.   It 
became  of  practical  importance  that  existing  plans  be  siib- 
jected  to  closer  scrutiny  making  use  of  quantitative  analytical 
measures  available. 

In  terms  of  methodology,  there  has  been  little  crit- 
icism of  the  findings  of  Lawshe  and  others.  Other  research 


Lawshe*s  system  of  factor  selection  still  did  not 
achieve  a  means  of  determining  vAiat  the  valid  weighting  of 
factors  should  be  for  amy  given  plan. 

^Reliability  of  job  evaluation  refers  to  the  con- 
sistency with  which  raters  using  the  same  system  achieve 
the  same  results  from  time  to  time,  or  the  consistency  with 
v^ich  other  raters  using  the  scune  system  independently  on 
the  same  jobs  come  up  with  the  same  results. 
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groups,  in  fact,  have  developed  similar  results.   How- 
ever, in  the  realm  of  human  relations  as  it  bears  upon 
practical  application,  the  simplified  system  has  been  crit- 
icized rather  severely. 

One  of  the  basic  problems  in  using  a  simplified 
system  relates  to  the  practical  difficulty  of  convincing 
employees  amd  supervisors  of  the  adequacy  of  such  a  plan. 
It  is  difficult  for  an  empltyee  to  see  how  a  rating  plan 
using  only  three  or  four  factors  can  adequately  value  his 
job.  Selling  the  standard  type  of  Job  evaluation  plaai  is 
difficult  enough  even  under  the  best  of  circumstances.  The 
difficulty  of  selling  zm  abbreviated  system  to  supervisors 
and  employees  is  multiplied  manyfold.  Furthermore,  use  of 
a  sin^lified  system  will  lead  to  difficulty  unless  the  rating 
committee  is  most  careful  to  detect  inadequate  coverage  of  any 
of  the  Jobs.  This  involves  an  intensive,  systematic 


^Por  additional  research  backing  up  Lawshe's  pro- 
posals seet  Allen  H.  Howard  and  H.  G.  Schutz,  "A  Factor 
Analysis  of  a  Salary  Job  Evaluation  Plan, "  Journal  of  Ap- 
plied Psycholocrv,  XXXVI,  No,  4  (August  1952),  pp.  243-246; 
John  A.  Oliver  and  Alexander  Winn,  "An  Abbreviated  Job  Eval- 
uation Plan  for  Salaried  Personnel,"  Personnel,  XXVIII,  No. 
3  (November  1951),  pp.  225-229;  David  J.  Chesler,  "Reliabil- 
ity of  Abbreviated  Job  Evaluation  Scales,"  Journal  of  Applied 
Psychology.  XXXII,  No.  6  (December  1948),  pp.  622-630; 
Donald  L.  Grant,  "An  Analysis  of  a  Point  Rating  Job  Evalua- 
tion Plan, "  Journal  of  Applied  Psychology,  XXXV,  No.  4 
(August  1951),  pp.  236-240. 
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orientation  and  training  of  raters  on  the  philosophy  and  use 
of  the  abbreviated  system. 

Commenting  on  Lawshe's  research  leading  to  the  devel- 
opment of  a  simplified  system  of  job  evaluation,  A.  L.  Kress, 
author  of  the  NEMA  plan,  vAiich  v/as  the  svibject  of  Lawshe's 
investigations,  made  the  following  comment t 

You  state  that  job  evaluation  plans  do  not 
need  eleven  factors  and  specifically  refer  to 
the  NEMA-Metal  Trades  Plan.   That  plan  is  now 
eleven  years  old.   It  is  undoubtedly  the  most 
widely  used  of  any  single  job  rating  plan. 
There  has  been  a  definite  reluctamce  to  re- 
vise the  plan  in  any  way  in  that  time;  first, 
because  of  the  large  number  of  installations 
euid  second,  to  avoid  any  criticism  on  the 
part  of  unions  that  the  "yard  stick"  was  being 
changed.   In  the  Metal  Trades  Association, 
the  plan  is  tied  into  its  comprehensive  pro- 
gram of  area  surveys.   It  would  be  inadvisable 
to  chamge  the  factors  even  if  Lawshe's  con- 
clusions were  accepted.   I  do  not  question 
his  statistical  analyses.   I  do  question  the 
wisdom  of  limiting  the  factors,  as  he  sug- 
gests, for  practical  use. 

It  is  reiterated  that  criticism  has  been  leveled 

only  at  the  advisaO^ility  of  using  fewer  factors  from  the 

hiiman  relations  viewpoint  and  not  from  the  standpoint  of 

mechanics.  These  criticisms,  however,  seem  to  offer  little 

more  than  opinions  and  lose  some  of  their  luster  when  it  is 

remembered  that  most  ;iactor  comparison  plans  have  been 


^" Job  Evaluation  Discussion, "  Personnel  Journal, 
XXVII,  No.  2  (June  1948),  p.  67, 
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successfully  using  only  five  factors  over  an  extended  number 
of  years*   Lawshe,  however,  recognized  the  possible  limita- 
tions Imposed  by  the  human  element  as  he  clearly  statedt 

It  Is  realized  that  frequently  it  Is  de- 
sirable to  use  Items  possessing  What  might 
be  termed  "face  validity"  in  spite  of  the 
fact  that  such  items  contribute  nothing 
additional  to  the  scale.   That  is,  if  super- 
visors and  employees  believe  that  a  certain 
element  is  important  and  are  agreed  that  it 
should  be  included,  it  may  be  highly  desir- 
able that  it  be  included  for  policy  reasons 
even  though  it  may  be  statistically  shovm 
that  its  contribution  is  nil. 

Lawshe  hastens  to  add  that  it  is  quite  conceivable 
that  to  attempt  too  fine  a  delineation  between  items  which 
ostensibly  measure  the  seune  basic  job  element  might  well  de- 
tract from  the  reliability  and  validity  of  the  scale.   For 
this  reason,  utmost  caution  should  be  used  in  factor  selection. 

If  an  administrative  decision  Is  made  to  use  an 
abbreviated  system,  it  would  be  wise  to  start  the  program 
using  a  standard  plan  of  Job  evaluation.   The  stsmdard  plan 
should  be  validated  emd  used  to  rate  all  unique,  xincheckable 
Jobs.   Complete  familiarity  with  the  plan  cmd  its  capabilities 
should  be  had  by  the  rating  committee.  After  a  period  of 


-'■C.  H.  Lawshe,  Jr.,  Edward  Dudek,  and  R.  F.  Wilson, 
"Studies  in  Job  Evaluation  VII:   Factor  Analysis  of  Two 
Point  Rating  Methods  of  Job  Evaluation, "  Journal  of  Applied 
Psychology,  XXXII,  No.  2  (April  1948),  pp.  125-126. 
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successful  use  of  the  validated  plem,  consideration  may  be 
given  to  simplifying  said  plan  through  the  use  of  factor 
analysis.  Again  the  plan  should  be  checked  to  ascertain 
%^ether  ratings  achieved  under  the  abbreviated  system  are 
valid.   If  so,  the  principal  problem  remaining  is  to  sell 
the  program.   In  this  case  the  selling  job  should  not  be  so 
difficult  of  accomplishment  since  a  successful  standard  has 
been  developed  (the  validated  standard  plan)  against  vihich  re- 
sults imder  the  simplified  plan  may  be  cc^pared. 

Studies  in  reliability  of  the  evaluation  plan.   The 
value  of  a  job  evalxoation  system  v»hich  gives  different  re- 
sults in  the  hands  of  equally  capable  but  different  raters 
or  in  a  re-rating  by  the  same  analysts  would  be  open  to  ser- 
ious question.   It  is  equally  evident  that  "if  the  reliabil- 
ity of  the  ratings  is  low,  resulting  differences  in  point 
values  or  wages  may  be  largely  influenced  by  the  correspond- 
ing chance  variations  in  the  judgments  of  the  raters  rather 
than  by  real  differences  in  the  system  being  used.  "-^  Since 
the  problem  of  wage  and  salary  differentials  depends  upon  a 
proper  relating  of  jobs  through  job  evaluation,  a  system  which 


^C.  H.  Lawshe,  Jr.  and  E.  J.  McCormick,  "What  Do  You 
Buy  With  the  Wage  or  Salary  Dollar,"  Personnel,  XXIV,  No.  2 
(September  1947),  p.  104. 
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is  not  wisely  conceived  and  is  subject  to  inconsistencies  in 
administration  might  well  contribute  to  Job  dissatisfaction 
and  poor  morale.   Since  frequent  re-ratings  or  rating  of  new 
jobs  is  necessary  in  maintaining  an  effective  system,  reliabil- 
ity is  imperative.   Furthermore,  the  validity  of  the  job  eval- 
uation plam  is  dependent  upon  the  degree  of  reliability 
achieved. 

Since  it  was  necessary  to  establish  some  type  of 
criterion  for  purposes  of  con^aring  results  of  research  into 
a  simplified  system  of  Job  rating,  the  question  of  reliability 
of  original  rating  results  (the  criterion  used)  arose  immed- 
iately. As  a  matter  of  fact,  Lawshe's  second  study,  in  the 
series  devoted  to  job  evaluation,  was  partially  concerned 
with  the  concept  of  reliability  not  only  of  the  newly  devel- 
oped simplified  program  but  also  of  original  rating  results 
xinder  the  longer  NEMA  plan.   However,  the  first  investiga- 
tion devoted  entirely  to  the  concept  of  program  reliability 
was  not  undertaken  until  about  1947.^  The  objectives  of  this 
research  were  the  determination  oft   (1)  reliability  of  total 


'''C.  H.  Lawshe,  Jr.,  "Studies  in  Job  Evaluation  II," 
op.  cit.,  pp.  183-184. 

'C.  H.  Lawshe,  Jr.  and  R.  P.  Wilson,  "Studies  in  Job 
Evaluation  VI:   The  Reliability  of  Two  Point  Rating  Systems,* 
Joxirnal  of  Applied  Psychology,  XXXI,  No,  4  (August  1947), 
pp.  355-365. 
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point  ratings  tmder  a  system  employing  a  rather  large  number 
of  factors;   (2)  reliability  of  a  simplified  system  employ- 
ing only  foiar  factors;  and  (3)  the  reliability  of  each  of 
the  individual  factors  in  both  systems. 

The  NEMA  system,  made  up  of  eleven  factors,  each  con- 
taining five  degrees,  was  again  used  to  represent  the  extended 
plan.  A  plan  involving  four  factors  was  developed  to  repre- 
sent the  simplified  plan.  Forty  different  jobs  were  chosen. 
Job  descriptions  were  adopted  fxcm   the  United  States  Employ- 
ment Service  National  Job  Description  Series.  Jobs  were 
chosen  which  were  obviously  familiar  to  most  industrial  job 
analysts.   Twenty  industrial  cuialysts  frcxn  different  firms 
agreed  to  cooperate  in  the  experiment  and,  on  the  basis  of 
random  selection,  ten  were  used  to  rate  jobs  using  the  NEMA 
system  and  ten  were  to  use  the  abbreviated  system.  In  order 
to  eliminate  as  much  bias  as  possible,  each  rater  rated  only 
twenty  of  the  forty  jobs  and   no  two  analysts,  \inder  either 
plan,  rated  the  same  twenty  jobs.  However,  raters  were  paired 
off  in  such  a  way  that  each  pair  rated  all  the  forty  jobs  but 
in  a  different  combination  from  any  other  pair.   In  analyzing 
results  and  computing  correlations,  each  pair  represented 
"one  man."  The  coefficient  of  reliability  both  for  total 
point  ratings  and  for  each  item  in  both  systems  was  determined 
on  the  basis  of  the  average  intercorrelation  of  the  ratings  of 


46 
five  men  (keeping  in  mind  the  fact  that  each  pair  was  equiva- 
lent to  one  man)  on  forty  jobs.  Results  from  both  systems 
were  not  as  high  as  might  be  expected.  However,  the  very 
nature  of  the  controlled  conditions  precipitated  the  rather 
low  intercorrelations.   In  Lawshe's  opinion,  the  fact  that 
each  of  the  emalysts,  working  in  his  own  organization,  vx>uld 
tend  to  view  each  job  in  terras  of  his  own  situation  lessened 
the  degree  of  reliability.   This,  coupled  with  the  fact  that 
there  was  no  chance  for  raters  to  work  out  verbally  any 
differences  or  misunderstandings  involving  the  plan  nor  was 
it  possible  to  give  zmy  uniform  training  or  instruction  in 
the  techniques  of  rating,  tended  to  impair  the  development  of 
a  true  index  of  reliability. 

In  order  to  offs^et  the  further  criticism  that  rating 
was  not  normally  accanplished  by  a  single  individual,  the  re- 
searchers made  use  of  the  Spearman-Brown  formula  to  determine 
an  index  of  reliability  which  would  result  from  the  pooled 
ratings  of  a  committee  composed  of  five  members.   It  was 
felt  that  the  reliability  of  the  group  ratings  more  closely 
approximated  the  true  situation  than  did  the  reliability  of 
the  ratings  of  a  single  analyst.  The  results  obtained  in  both 
the  first  and  second  instances  are  shown  in  the  following 
table: 
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ThBLB   2 


AVERAGE  INTERCORRELATIONS  OF  RATINGS  USING  A  SIMPLIFIED 
JOB  EVALUATION  SYSTEM  AND  THE  NEMA  SYSTEM 


"1" 

"5" 

Item 

against 

against 

"1"^ 

"5««b 

Simplified  System 

General  schooling 

.79 

.95 

Learning  period 

.86 

.97 

Working  conditions 

.61 

.89 

Job  hazards 

.51 

.84 

Total  points 

.89 

.98 

NEMA  System 

Education 

.77 

.94 

Experience 

.82 

.96 

Initiative  amd  ingenuity 

.78 

.95 

Physical  demand 

.47 

.82 

Mental  or  visual  demand 

.37 

.75 

Responsibility  for 

equipment 

.41 

.78 

Responsibility  for 

material 

.40 

.77 

Responsibility  fcr 

safety  of 

others 

.54 

.85 

Responsibility  for 

work  of 

others 

.51 

.84 

Working  conditions 

.54 

.85 

Unavoidable  hazards 

.34 

.72 

Total  points 

.77 

.94 

Sources  Lawshe  and  Wilson,  "Studies  in  Job  Evaluation 
VI,  op.  cit.,  p.  360. 

*"1  against  1**  meams  most  likely  correlation  between 
ratings  of  one  rater  with  the  rating  of  one  other  rater. 

^'*5   against  5"  mesms  most  likely  correlation  between 
ratings  of  five  raters  with  the  rating  of  five  other  raters. 
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In  viewing  these  results,  several  facts  became  appar- 
ent.  The  first  conclusion  vAiich  may  be  dravm  is  that  the 
abbreviated  system  as  a  \^ole  tends  to  be  more  reliable  thzm 
the  elongated  system  and  that  five  of  the  item  indexes  in  the 
"5  against  5"  rating  for  the  NEMA  system  are  lower  than  the 
lowest  reliability  index  in  the  simplified  plem.   Secondly, 
in  view  of  the  fact  that  previous  investigations  seemed  to 
indicate  that  items  malcing  up  the  factor  labeled  "skill  de- 
mands" accounted  for  practically  all  the  variamce  in  total 
points,  it  is  interesting  to  note  that  in  both  systems  those 
items  normally  measuring  "skill  demands"  show  a  relatively 
high  index  of  reliability  compared  to  other  items.  And  lastly, 
it  is  to  be  noted  that  contrary  to  the  NEMA  system,  the  re- 
liability of  total  points  for  the  sin^lified  system  was 
greater  than  any  of  its  individual  items.   This  would  seem  to 
Indicate  that  each  component  item  made  some  contribution  to 
total  reliability. 

An  interesting  and   iraportzmt  result  emerged  from  a 
second  Lawshe  -  Farbo  stu<^.    Since  the  original  rating  com- 
mittee was  made  up  of  management,  supervisory  and  union 


"•■C.  H.  Lawshe,  Jr.  and  Patrick  C.  Farbo,  "Studies  in 
Job  Evaluation  VIII:   The  Reliability  of  an  Abbreviated  Job 
Evaluation  System,"  Journal  of  Applied  Psychology,  XXXIII, 
No.  2  (April,  1949),  pp.  158-166. 
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representatives,  comparisons  were  made  of  inter-rater  reli- 
ability between  the  two  memagement  representatives  as  well  as 
between  the  two  union  representatives.  Ratings  between  the 
two  management  representatives  were  consistently  higher  than 
for  the  union  men.   In  addition,  the  range  of  variation  was 
considerably  less  (see  Table  3). 

T^BLB  3 

COEFFICIENTS  OF  RELIABILITY  FOR  TWO  lABOR  AND  TWO 

MANAGEMENT  JOB  EVALUATION  COMMITTEE  MEMBERS 


Item 

Labor- 

Management- 

Irfibor 

Management 

Total  points 

.83 

.94 

Learning  period 

.73 

.86 

General  schooling 

.71 

.92 

Working  conditions 

.37 

.90 

Job  hazards 

.68 

.80 

Source:  C.  H.  Lawshe,  Jr.,  and  Patrick  Farbo, 
'Studies  in  Job  Evaluation  VIII, "  op.  cit.,  p.  162. 


Similarly,  since  two  different  sets  of  ratings  were 
available  for  each  Job  —  the  initial,  independent  ratings 
and  the  adjusted  ratings  resulting  from  conference  discussions 
—  the  relationship  between  initial  ratings  as  made  by  manage- 
ment, superintendents,  and  labor  and  the  mode  of  adjusted 
ratings  were  studied.  Once  again,  memagement  representa- 
tives were  more  consistent  in  their  ratings  than  were  union 
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members.   In  addition,  the  superintendents'  ratings  were 
also  more  reliable  than  labors'  ratings;  however,  results 
revealed  that  the  ratings  of  the  superintendents  were  some- 
what more  accurate  than  those  of  the  management  committee 
members.   These  findings  would  seem  to  bear  out  the  conten- 
tion that  proximity  to  the  Jobs  under  consideration  with  a 
maximvim  understanding  of  job  content  is  all  important  in  re- 
liability of  ratings. 

In  1948,  research  in  the  area  of  reliability  of  job 
evaluation  was  undertaken  by  Leonard  Cohen,  lecturer  in  Psy- 
chology at  Purdue  University.   A  Pittsburgh  Machine  tool 
company,  using  the  same  NEMA  system,  was  the  siibject  of  inves- 
tigation.  In  this  case  a  re-evaluation  of  the  key  job  scale 
was  made  by  a  two  man  committee  made  up  of  the  chief  indus- 
trial engineer  and  a  union  representative,  both  members  of 
the  original  rating  committee.   The  index  of  reliability  (co- 
efficient of  reliability)  based  on  original  points  assigned 
to  jobs  as  compared  to  re-evaluated  points  assigned  the  same 
jobs  was  .949.   Cohen  hastens  to  admit,  however,  that  such  a 
high  reliability  might  be  due  to  the  fact  that  only  key  jobs 
covering  a  wide  range  of  values  were  rerated.   Had  the  range 


Leonard  Cohen,  "More  Reliable  Job  Evaluation, " 
Personnel  Psychology,  I,  No.  4  (Winter,  1948),  pp.  457-464. 
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been  narrowed  and  Jobs  chosen  T^hlch  vrere  more  closely  related, 
it  is  quite  possible  that  the  coefficient  would  have  been  re- 
duced considerably. 

A  second  re-^evaluation  was  undertaken  by  an  indus- 
trial engineer,  foreign  to  the  division,  although  completely 
familiar  with  the  NMTA  plan  \Aiich  is  quite  similar  to  the  NEMA 
plan.  Using  the  original  job  descriptions  and  personally  ob- 
serving each  job,  he  rated  each  key  job  on  all  factors.  When 
these  scores  were  compared  to  original  ratings,  the  coeffic- 
ient was  calculated  to  be  ,951.  According  to  the  author, 
these  high  indices  of  reliability  indicate  that  "no  matter  who 
performs  the  job  evaluation,  so  long  as  he  is  adequately 
trained  in  the  techniques  of  the  job  evaluation  method,  the 
resultant  hierachy  of  jobs  will  be  substantially  the  same."^ 

A  refinement  in  experimental  approach  to  reliability 
determination  was  brought  to  light  by  David  J.  Chesler  of 
the  Personnel  Research  Institute  at  Western  Reserve  Univer- 
sity.^ In  vindertaking  his  study,  Chesler  suggested  the  seem- 
ingly obvious  fact  that  in  job  evaluation  research  there  are 
three  variables:  (1)  the  jobs,  (2)  the  raters,  and  (3)  the 


^Ibid.,  p.  459. 

2j.  Chesler,  "Reliability  and  Comparability  of  Dif- 
ferent Job  Evaluation  Systems, "  Journal  of  Applied  Psychology 
XXXII,  No.  5  (October  1948),  pp.  465-475. 


82 

rating  manuals.   Therefore,  in  any  thorough  experimental  pro- 
cedure Involving  the  concept  of  reliability  of  job  rating* 
cognizance  must  be  taken  of  \^ich  factors  are  being  held  con- 
stemt  and  which  varied.   However,  if  inter-institution  reli- 
ability studies  are  to  be  undertaken,  the  problem  would  be 
broadened  to  include  variations  in  systems  used.   Chesler's 
initial  research  was  directed  at  ascertaining  the  extent  to 
which  different  job  evaluation  systems  gave  the  same  results 
when  jobs  and  raters  were  held  constant  and,  secondly,  deter- 
mining the  reliability  of  individual  raters  vdien  both  manual 
and  jobs  were  held  constsmt  and  only  raters  varied. 

In  the  first  research  project,  descriptions  for 
thirty-five  clerical,  supervisory  and  administrative  jobs  were 
extracted  from  the  files  of  a  large  organization.   Contrary 
to  previous  investigations  where  jobs  used  were  ^hypothetical, 
this  project  involved  jobs  actually  existing  in  a  going  con- 
cern.  They  included  a  wide  range  of  activities  typical  of 
salaried  positions  in  an  industrial  orgemlzation.   These  jobs 
were  labeled  "standard  jobs."   In  addition,  the  "standard 
manual,"  to  be  used  in  a  portion  of  the  research,  was  devel- 
oped by  the  Personal  Research  Institute  of  Western  Reserve 
University  and  was  typical  of  many  point  systems  both  in  terms 
of  type  emd  number  of  factors  used.   Nine  orgzmizations  lo- 
cated in  Cleveland,  Ohio,  participated  in  the  stu<^;  the 
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number  of  analysts  in  each  coiv^jany  ranged  from  one  to  three. 
Each  was  highly  trained  sind  possessed  a  good  deal  of  exper- 
ience inasmuch  as  Job  evaliiation  was  the  individual's  primary 
responsibility  in  most  cases. 

Raters  in  each  of  the  nine  companies  were  asiked  to 
rate  the  30  "standard  jobs"  on  the  "standard  manual"  and  then 
to  rate  the  same  Jobs  on  their  o%<n  compciny  manual  keeping  the 
two  ratings  as  independent  as  possible.  To  further  reduce 
bias,  in  use  of  the  "standard  manual,"  points  assigned  to 
factors  and  degree  levels  were  not  made  known.   Total  point 
values  reported  by  analysts  from  the  first  seven  companies 
submitting  information  were  then  correlated.   In  no  case  did 
an  interrater  correlation  coefficient  fall  below  ,93  with  the 
highest  index  of  .99  and  an  average  of  .97.  The  "standard 
manual"  apparently  was  highly  reliable  provided,  of  course, 
the  criterion  of  original  total  scores  could  be  assiimed  to  be 
reliable.   In  Chesler's  opinion,  the  "key  to  the  magnitude  of 
these  coefficients  lies  in  the  thoroughness  and  detailed 
nature  of  the  Job  descriptions  and  specifications  of  the 
standard  jobs." 

Further  analysis  involving  product  moment  correla- 
tions between  each  factor  of  the  "standard  manual"  and  the 


•'•Ibid. ,  p.  471. 
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total  scores  for  each  of  the  thirty- five  "stemdard  jobs"  re- 
vealed a  high  degree  of  individual  factor  reliability  for 
all  but  the  factor  "pressure  of  work,"   The  range  of  vari- 
ability ran   all  the  vay  from  .01  for  the  factors  "work  ex- 
perience" and  "getting  along  with  others"  to  .13  for  such 
items  as  "character  of  supervision  received"  and  "responsi- 
bility for  accuracy."  There  was  a  range  of  .46  for  the 
factor  "pressure  of  work";  however,  results  indicated  that 
one  orgamization  evidently  interpreted  the  factor  entirely 
differently  from  the  other  organizations  involved.   This  dif- 
ference in  opinion  serves  to  point  up  the  need  for  inter- 
individual  corara\anication  (a  condition  puirposely  lacking  in 
this  project)  for  purposes  of  clarifying  any  such  issue. 

A  final  computation,  involving  intercorrelations  among 
the  Job  point  scores  as  developed  from  six  different  company 
manuals,  produced  coefficients  remging  from  .89  to  .97,  rather 
high  indeed  considering  the  fact  that  the  manuals  included 
both  point  rating  systems  and   factor  comparison  systems. 
These  high  intercorrelations  indicated  a  high  degree  of 
commonalty  among  different  systems.   Consequently,  according 
to  Chesler,  such  a  high  degree  of  relationship  would  seem  to 
indicate  that  the  type  of  system  used  is  not  so  in5)ortant  as 
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the  competency  of  those  vflio  are  to  analyze  and  rate  the  Jobs 
and  the  integrity  with  which  the  system  is  installed  and 
maintained. 

The  results  of  these  studies  tend  to  sxibstantiate  the 
idea  that  reliability  between  systems,  or  more  importantly, 
between  raters,  particularly  if  these  raters  have  not  been 
thoroughly  trained  in  the  rating  process,  may  vary  consid- 
erably.  There  is  little  question  that  such  variation,  if  not 
controlled  and  eliminated,  will  create  internal  disturbances 
and  ultimately  reduce  the  Job  evaluation  system  to  a  hollow 
mockery.   The  general  consensus  seems  to  be,  however,  that 
rating  variations  can  be  controlled  provided  certain  preven- 
tive measures  are  taken. 

The  aforementioned  research  verifies  the  need  for 
undertaking  a  complete  analysis  of  inter-rater  reliability 
prior  to  initiation  of  the  evaluation  program.   In  addition, 
since  rerating  of  chamged  Jobs  as  well  as  rating  of  new  jobs 
is  a  continuing  process,  a  periodic  check  should  be  made  on 
the  consistency  of  ratings.   It  is  virtually  impossible  to 
determine  the  validity  of  the  plan  vrLthout  proper  reliability. 
Consequently,  the  importance  of  a  reliable  Job  evaluation 
system  cemnot  be  overstated. 

^Ibid. ,  p.  473. 
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Studies  in  the  validity  of  the  evaluation  plan.   The 
most  recent  research  devoted  to  further  refinement  of  job 
evaluation  has  centered  in  validation  studies.   In  view  of 
the  importance  of  validating  the  rating  plan,  it  appears  odd 
that  the  concept  of  validity  was  the  last  to  be  investigated. 
Most  of  the  texts  dealing  with  job  evaluation  fail  to  delve 
into  the  subject.   Perhaps  the  general  attitude  is  taken  that 
"although  the  various  techniques  of  evaluating  the  accuracy 
of  the  job  evaluation  established  in  a  particular  company  may 
be  helpful,  in  the  final  analysis,  statistics  are  never  a 
suitable  measure  of  the  adequacy  of  a  job  evaluation  program.''2 
Actually,  statistics  are  an  essential  part  of  the  process  of 
validating  the  job  evaluation  program.   Since  validity  re- 
quires a  determination  of  the  degree  of  relationship  between 
the  external  criteria  of  market  wage  rates  and  internal  total 
point  ratings  for  key  jobs,  it  is  evident  that  some  quanti- 
tative measure  of  correlation  is  necessairy.   Furthremore,  if 
the  system  in  use  proves  invalid,  the  only  adequate  way  of 


Validity  of  the  job  evaluation  plan   refers  to  the 
ability  of  the  plan  to  evaluate  key  jobs  in  the  same  rela- 
tive position  as  they  have  been  evaluated  by  the  going  rates 
for  such  jobs  in  the  labor  market  in  question. 

*J.  L.  Otis  and  Richard  H.  Letikart,  Job  Evaluation, 
A  Basis  for  Sound  Wage  Administration  (New  York;  Prentice- 
Hall,  Inc.  1948),  p.  337. 
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adjusting  factor  weights  in  order  to  achieve  validity  is 
through  the  use  of  multiple  correlation.   Consequently,  to 
condemn  the  use  of  statistics  as  a  mezms  of  determining  the 
adequacy  of  the  job  evaluation  prograun  is  tantamovint  to 
destroying  the  value  of  the  plan  itself. 

The  real  measure  of  usefulness  of  any  job  evaluation 
plan  is  the  extent  to  which  it  is  capable  of  predicting  the 
proper  relative  value  of  intermediate  unique  or  uncheckable 
jobs.   In  determining  the  prediction  potential  of  the  rating 
plan,  it  is  first  necessary  to  estsQslish  adequate  external 
criteria  against  v^ich  point  ratings  for  individual  key  jobs 
might  be  correlated.   In  the  case  of  job  evaluation,  the 
necessary  external  criteria  are  the  going  wage  rates  for 
selected  key  jobs  in  the  labor  market  in  question.   If  the 
jobs  selected  are  in  actuality  key  jobs,  the  going  rates  for 
such  jobs  in  fact  reflect  the  independent  Judgment  of  the 
market  as  to  their  relative  worth  and  presumably  reflect  in- 
herent job  demands.  Reluctamce  to  accept  this  fact  has  per- 
haps been  the  greatest  stiinibling  block  to  the  development  of 
the  concept  of  validity.   In  the  field  of  wage  administra- 
tion, adequate  and  accurate  external  criteria  are  difficult 
of  attainment.  As  J.  P.  Guilford,  Professor  of  Psychology  at 


■^Assuming  linearity  of  the  regression  (wage)  line. 
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the  University  of  Southern  California  expressed  itj   "One  of 
the  most  difficult  of  all  aspects  of  the  validity  problem  is 
that  of  obtaining  adequate  criteria  of  vihat  we  are  measuring,"^ 

Admittedly,  there  are  serious  hurdles  that  must  be  overcome 
if  the  criteria  developed  are  to  be  useful;  hov»ever,  these 
problems  are  not  impossible  of  solution* 

One  of  the  most  serious  difficulties  in  establishing 
external  criteria  is  securing  emd  maintaining  adequate  and 
comparable  wage  information  from  the  local  labor  market.   In 
order  for  the  criteria  to  be  of  any  value,  jobs  on  which  com- 
munity wage  infoiroation  is  sought  must  be  comparable  to  those 
in  a  given  organization.   Precise  wage  information  is  some- 
times difficult  to  secure.   However,  adequate  v/age  information 
may  be  obtained  provided  a  reasonable  eunount  of  effort  is  ex- 
pended.  Information  of  this  nature  is  particularly  useful  if 
the  data  are  obtained  through  wage  surveys  on  a  cooperative 
basis  by  a  group  of  local  concerns.   It  is  most  essential  that 
obtained  wage  data  show  stability  of  key  Job  relationships 
over  a  period  of  time.   Only  vmder  such  conditions  can  the 

data  be  considered  to  reflect  inherent  Job  dememds  and,  there- 
fore, be  useful  as  external  criteria  in  the  validity  process. 


^J.  P.  Guilford,  Fvindamental  Statistics  in  Psychology 
and  Education  (3rd  ed. :  New  York t  McGraw-Hill  Book  Company, 
Inc.,  1956),  p.  463. 
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One  of  the  £lrst  realistic  and  adequate  methods  of 
testing  for  the  validity  of  the  job  evalviation  plan   was  devel- 
oped by  Bernard  H.  Fitzpatrick.   While  undertaking  rate  sur- 
vey activities  for  the  Commerce  and  Industry  Association  of 

2 

New  York,   Fitzpatrick  attempted  to  establish  scane  means  of 

checking  on  both  the  stability  of  key  job  relationships  over 
a  period  of  time  and  the  validity  of  the  job  rating  plan.  For 
a  four  year  period,  during  vdiich  time  he  was  in  charge  of  the 
rate  surveys,  Fitzpatrick  was  impressed  with  the  extent  to 
Which  certain  job  rate  relationships  remained  relatively  un- 
changed over  a  period  of  time.  This  relationships  held  true 
even  though  the  eJssolute  rate  for  individual  jobs  varied  con- 
siderably. From  the  rate  information  collected^  a  "Relative 

3 
Job  Value  Scale"  for  57  clerical  jobs  was  developed.   Fitz- 
patrick cautioned  that  such  a  relative  scale  would  be  of 
value  only  if  established  from  wage  information  collected 
within  the  local  labor  market;  consequently  the  scale  as 


•^Bernard  H.  Fitzpatrick,  "An  Objective  Test  of  Job 
Evaluation  Validity, "  Personnel  Journal,  XXVIII,  No.  4 
(September  1949),  pp.  128-132. 

^From  a  telephone  conversation  between  the  writer  and 
Mr.  Fitzpatrick  on  August  23,  1960.   Mr.  Fitzpatrick  is  now 
an  industrial  relations  lawyer  associated  with  the  firm  of 
Butler,  Fitzpatrick,  De  sio  and  Keating  in  New  York  City. 

^Fitzpatrick,  op.  cit.,  p.  131. 
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presented  would  be  of  value  only  in  New  York  City,  vAiere  the 
wage  rates  were  gathered.  This,  of  course,  would  not  limit 
the  general  application  of  the  idea. 

The  basis  for  Pitzpatrick' s  hypothesis  concerning  the 
constant  relationship  between  certain  types  of  jobs  rested  on 
the  statistical  concept  of  large  n\ambers.  As  he  explained 
the  ideas   "Since  vinique  circumstances  of  particular  employees 
and  particular  comoanies  have  canceled  e«ch  other,  the  resi- 
due, the  constant  ratio,  represents  the  objective  judgment 
of  the  employment  market  on  the  relative  worth  of  the  jobs." 
In  addition,  such  relative  rates  presxomable  reflect  inherent 

job  demands. 

These  constant  ratios  represented  the  external  cri- 
teria so  necessetry  in  validating  the  job  rating  plan  and, 
consequently,  constituted  an  important  support  for  his  devel- 
opment of  the  concept  of  validity.   It  is  evident  that  the 
author  recognized  the  proper  usage  of  the  established  criteria 
for  he  state ss   "If  a  company  evaluates  its  clerical  jobs  and 
the  ratios  of  the  evaluations  accord  with  the  ratios  between 
scale  points  for  identical  jobs  in  the  R.J.V.  Scale,  the 
evaluation  is  a  proper  one  as  to  those  jobs...   also  the 

particular  plan  as  a  vftiole  is  proper,  and  the  intermediate 

2 
uncheckable  jobs  have  probably  been  properly  rated." 


^Ibid. ,  p.  129.    ^Ibid. 
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Fitzpatrick  was  also  a\«are  of  the  difficulties  that 
might  be  encountered  if  the  content  was  not  uniform  Isetveen 
the  job  representing  the  general  maurket  rate  and   the  same 
job  vithin  the  organization.  Any  sizeable  difference  that 
might  exist  would  negate  the  value  of  the  external  criteria. 
As  a  measure  of  possible  variation  in  job  definitions*  Fitz- 
patrick used  the  dispersion  of  reported  rates  for  the  job.  He 
theorized  that  the  less  defineible  the  job  smd  the  more  subject 
the  job  was  to  variation  in  duties,  the  wider  the  range  of 
rates  would  be.  From  the  resultant  dispersion  was  developed 
an  ascending  and  descending  cumulative  frequency  curve  (an 
Ogive  Rating  Scale) .   The  area  under  this  curve  was  then  com- 
pared to  the  area  enclosed  by  the  cumulative  frequencies  of 
the  normal  probability  curve.   If  there  were  little  or  no 
variations  in  reported  rates  the  distribution  would  appear 
as  a  point  within  the  probability  curve.  On  the  other  hand, 
a  rate  distribution  falling  within  the  probability  curve  would 
constitute  a  value  of  1.00  or  less,  A  dispersion  of  rates 
falling  outside  the  probability  curve  would  appear  as  a  mixed 
number.   It  was  Fitzpatrick • s  experience  that  any  job  with  an 
Ogive  Rating  Scale  Value  of  2.00  or  more  should  be  discarded 
as  a  key  job  for  validation  purposes  because  of  the  likeli- 
hood that  the  job  content  would  vary  to  such  an  extent  as  to 
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make  even  a  median  wage  value  for  the  Job  relatively  useless 
as  a  criterion  figure. 

Although  such  a  procedure  as  that  created  by  Fitz- 
patrick  for  assessing  the  range  of  rate  variability  is  quite 
acceptable,  equally  adeq\aate  results  may  be  obtained  from  per*- 
sonal  interviews  in  the  labor  market  in  question  to  determine 
key  Job  rates. 

In  1956,  William  M.  Fox  was  faced  with  the  problem  of 
establishing  a  valid  system  of  Job  evaluation  to  cover  a  groip 
of  hourly  paid  workers  at  the  University  of  Florida.  •'■  The 
basic  National  Metal  Trades  Plan  of  evaluation  was  used.   This 
plan  was  originally  developed  for  the  Western  Electric  Company 
and  adapted  by  A.  L.  Kress  in  1935,  for  the  National  Electri- 
cal  Msmufacturers  Association.   Further  refinements  and 
improvements  were  incorporated  into  the  plan  by  the  Metal  Trades 
group  for  their  specific  use. 

The  principle  problem  was  to  deteinnine  whether  the 
evaluation  system  as  applied  was  in  actuality  a  proper  measure 
of  Job  relationships.  As  in  the  development  of  any  means  of 
testing  validity,  it  was  necessary  to  establish  external 


^William  M.  Fox,  "Job  Evaluation  of  Hourly  Paid  Jobs 
at  the  University  of  Florida, "  1956.   (Unpublished) . 

^Lytle,  op.  cit.,  p.  50. 
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criteria  against  \^ich  independently  rated  job  point  values 
might  be  compared.   In  this  instance,  a  labor  market  sujrvey 
was  undertaken  to  arrive  at  a  "normal"  wage  rate  for  each  of 
the  selected  key  jobs  to  be  used  in  the  validation  process, 
A  weighted  average  of  the  going  rates  for  these  key  jobs 
represented  the  objective  judgment  of  the  labor  market  as  to 
the  relative  worth  of  said  jobs. 

Extraordinary  precaution  was  taken  to  see  that  the 
content  of  the  external  jobs,  for  vfliich  wage  information  was 
sought,  closely  approximated  that  of  the  key  jobs  being  rated. 
In  m2my  instances  job  titles  or,  at  best,  simple  written  de- 
scriptions are  used  to  check  the  comparability  of  job  content. 
In  this  instance,  however,  visits  were  made  to  a  number  of 
businesses  in  the  community  to  make  absolutely  certain  that 
the  jobs  being  compared  were  as  nearly  alike  in  content  as 
possible.   In  the  final  analysis,  the  usefulness  of  the  pro- 
gram rests  upon  this  important  step. 

Once  the  labor  market  average  wage  for  the  key  jobs 
was  ascertained,  it  was  plotted  against  the  total  point  rat- 
ings for  the  same  jobs.   Inasmuch  as  the  externally  developed 
wage  differentials  accurately  measured  relative  job  worth, 
if  the  independently  determined  point  ratings  gave  the  same 
or  essentially  the  same  ratio  of  job  worth,  it  could  reason- 
ably be  ass\imed  that  the  job  evaluation  system  was  capable 
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of  adequately  predicting  the  value  of  Intermediate  unique 
jobs.   Proper  Interpolation  of  knovn  and  unknovm  job  values 
vas  now  possible. 

Simple  correlation  was  the  statistical  procedure 
applied  to  obtain  a  more  concrete  measure  of  the  degree  of 
relationship  between  the  two  sets  of  data.   The  resultant  co- 
efficient became  an  abstract  measure  of  the  validity  of  the 
job  rating  prograun.   In  the  particular  situation  under  dis- 
cussion. Pox  came  up  with  a  coefficient  exceeding  .95  Indi- 
cating a  highly  significant,  dependable  relationship.  This 
was  In  keeping  with  the  findings  of  Guilford  regarding  the 
strength  of  relationship  as  expressed  by  "  V  ,"   It  was  his 
experience  that  In  general  "a  coefficient  of  from  .90  -  1.00 

denotes  a  very  high  correlation  and  a  highly  dependable  rela- 

2 

t ion ship." 

Subsequent  investigations  and  research  in  the  area  of 
job  evaluation  validation  by  graduate  students  under  the  di- 
rection of  Fox  have  substantiated  the  need  for  achieving  a 
high  validity  coefficient  if  the  rating  program  is  to  be  con- 
sidered acceptable.   Continued  experimentation  into  this 


^Guilford  refers  to  this  specific  measure  as  a  validity 
coefficient  —  an  index  of  practical  validity.  J.  P.  Guilford, 
op.  cit.,  p.  145. 

^ibid. 
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approach  to  validation  might  well  see  the  development  of  a 
minimum  validity  coefficient  serving  as  a  test  of  practical 
usefulness  of  the  Job  evaluation  plan. 

Another  most  important  contribution  of  Fox  was  his 
recognition  of  a  means  by  which  validity  might  be  achieved 
through  manipulation  of  factor  weights.  The  procedxure 
assumes  reliability  of  ratings,  adequacy  of  factor  coverage 
and  linearity  of  the  regression  line  (wage  line) .  Once  these 
conditions  have  been  met,  factor  weights  may  be  meuiipulated 
through  the  use  of  multiple  correlation  to  achieve  optimxim 
results.   In  this  maruier,  even  an  invalid  evaluation  plan  may 
be  developed  into  a  "correct"  plr.n  that  will  give  valid  re- 
sults. These  studies  in  validity  provided  the  "cap  stone" 
in  the  development  of  job  evaluation  as  an  effective  and  use- 
ful tool  in  wage  administration. 


Recapitulation  of  the  most  important  developments  in  the 
evolution  of  job  evaluation 


The  foregoing  chapter  has  discussed  in  some  detail  the 
principal  advances  leading  up  to  the  present  day  concept  of 
job  evaluation. 

In  summary,  the  more  important  developments  in  the 
area  of  job  evaluation  were  as  follows: 
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1.  Recognition  by  the  Chicago  Civil  Service 
Coimni salon  of  the  need  for  more  adequate 
job  Information.   The  resultant  Improve- 
ments Involved  both  job  duties  and  neces- 
sary job  specifications. 

2.  The  use  of  the  job  evaluation  committee  by 
W.  D.  Steams  and  Eugene  J.  Benge.   The 
use  of  committee  decisions  overcame  the 
bias  Inherent  In  xinl lateral  decisions  In 
job  evaluation. 

3.  The  creation  by  Merrill  Lott  of  a  point 
plan  of  job  evaluation  using  weighted  sep- 
arate job  factors.   Lott's  plan  was  a  long 
stride  forward  In  the  development  of  eval- 
uation plans  v^lch  give  a  more  accurate 
appraisal  of  job  worth. 

4.  The  development  of  a  system  of  key  or 
bench-mark  jobs  by  Eugene  J,  Benge.   This 
advance  In  technique  prepared  the  way  for 
later  development  of  validity  checks. 

5.  Recognition  by  Eugene  J.  Benge,  D.  W.  Weed 
and  A.  W.  Bass,  Jr.,  of  the  need  for  re- 
ducing the  nvunber  of  job  factors.   How- 
ever, C.  W,  Lawshe,  Jr.,  Is  credited  with 
the  development  of  a  more  precise  means 

of  simplifying  the  point  plan  of  rating 
through  reduction  In  the  number  of  factors 
used. 

6.  The  work  of  C.  H.  Lawshe,  Jr.,  E.  J. 
Mccormick,  R.  F.  Wilson,  Leonard  Cohen 
amd  David  J,  Chesler  In  the  development 

of  means  of  checking  on  program  reliability. 

7.  Recognition  by  Bernard  H.  Fltzpatrlck  and 
William  M.  Fox  of  the  need  for  validating 
the  job  evaliStlon  plan.   This  last  contri- 
bution was  perhaps  the  crowning  accomplish- 
ment In  development  of  the  evaluation  pro- 
gram as  a  useful  tool  of  management. 
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This  historical  review  of  creative  efforts  in  the 
development  of  more  "scientific"  Job  evaluation  has  served 
primarily  to  give  a  proper  perspective  to  the  study  \^ich  is 
to  follow.   It  is  believed  that  cuiy  useful  and  helpful  eval- 
uation of  hospital  activities  in  the  area  of  job  evaluation 
must  of  necessity  be  established  within  the  framework  of  re- 
search and  experimentation  ^ich  has  been  previously  under- 
taken.  'These  aforementioned  criteria  of  good  job  evaluation 
practices  will  be  applied  to  survey  finding  in  an  effort  to 
determine  the  extent  of  their  application  in  hospitals.   With 
this  general  background  information  in  mind,  the  succeeding 
study  should  assume  added  meaning  euid  importance. 


CHAPTER  III 
RESULTS  OF  THE  HOSPITAL  STUDY 

Methodology  of  Hospital  Study 
General  statement  of  the  problem 

The  field  of  Hospital  Administration  offers  an  ex- 
cellent opportxinity  to  apply  fxindamental  managerial  con- 
cepts of  business  operation.   Only  relatively  recently  have 
many  generally  accepted  management  techniques  and  concepts 
been  introduced  in  the  hospital  2uid  many  problem  areas  re- 
main to  be  investigated.   One  of  the  most  iir5>ortant  diffi- 
culties facing  the  Hospital  Administrator  is  the  need  for 
properly  evaluating  jobs  under  his  control  for  purposes  of 
setting  up  and  operating  an  equitable  wage  and  salary  pro- 
gram.  This  problem  area  is  of  special  importance  since  the 
administrator  must  not  only  deal  with  specialized  hospital 
persoimel  but  also  with  a  rather  sizeable  staff  of  business 
personnel  including  accountants,  typists,  stenographers, 
office  managers  and  the  like.   Since  such  occupations  are 
normally  in  direct  competition  with  like  jobs  in  businesses 
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in  the  commiinlty,  a  satisfactory  program  of  job  evaluation 
and  v/age  administration  must  be  undertaken  by  the  adminis- 
trator if  he  expects  to  retain  his  work-force  intact  with- 
out costly  turnover  problems.  The  problem  assun«s  added  sig- 
nificance when  it  becomes  apparent  that  between  65  and  70  per 
cent  of  operating  costs  for  the  average  hospital  are  accounted 
for  by  wages  and  salaries. 

The  present  study  will  seek  to  assess  the  criticism 
that  little  has  been  done  in  the  field  of  hospital  administra- 
tion to  develop  a  more  formal  approach  to  measuring  relative 
job  worth.  Although  the  study  is  confined  to  hospitals,  com- 
parisons are  made  with  Job  evaluation  studies  in  other  fvmc- 
tional  fields  in  order  to  present  significant  contrasts. 
Collection  of  data  was  accomplished  during  a  seven  month 
period  extending  from  August,  1959  through  February,  1960. 
Information  was  gathered  through  personal  visitations  of 
nximerous  hospitals  for  first  hand  discussions  with  adminis- 
trators and  personnel  managers.  Additional  data  were  secured 
through  an  intensive  distribution  of  mailed  survey  sheets. 
Results  of  both  approaches  to  the  problem  have  been  inte- 
grated for  a  more  comprehensive  presentation.  The  selection 


Donald  Wood,  "They  Live  and  Learn  With  Unions," 
The  Modem  Hospital,  XVllI,  No.  1  (July,  1959),  pp.  73-75. 
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of  hospitals  for  inclusion  in  the  study  was  not  made  on  a 
random  basis;  consequently,  Seunpling  theory  is  not  applicable 
for  purposes  of  establishing  statistical  reliability  of  pre- 
dictions. However,  since  approximately  35  per  cent  of  the 
largest  hospitals  in  the  country  responded  to  the  survey,  it 
is  felt  that  valid  generalizations  are  warranted. 

Scope  of  study  -  personal  visits 

In  order  to  secure  first-hand  information  regarding 
the  current  status  of  job  evaluation  in  hospitals,  a  personal 
visit  to  sixty  different  hospitals  v*as  made.  Hospitals 
visited  were  located  in  the  geographical  area  from  Jackson- 
ville, Florida  to  New  York  City.   In  addition,  several  hos- 
pitals in  the  greater  Pittsburgh  area  were  visited.   In  the 
personal  survey,  no  attempt  was  made  to  select  hospitals  on 
the  basis  of  size  or  ownership.  Hospitals  visited  included 
small,  medium  cind  large  institutions  with  both  profit  and 
non-profit  hospitals  represented. 

In  each  instance  interviews  were  arranged  with  either 
the  administrator  or  the  personnel  director  of  the  hospital 
in  order  that  reliable  information  could  be  obtained.  Where 
formal  Job  evaluation  plans  were  foxind  to  exist,  lengthy  dis- 
cussions were  held  with  the  individuals  responsible  for 
development  and/or  operation  of  the  system.   In  addition. 
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contacts  were  made  with  consulting  firms  with  experience  in 
developing  and  implementing  job  evaluation  programs  in  the 
hospital. 

For  more  intensive  and  prolonged  analysis,  job  eval- 
uation manuals  were  secured  from  hospitals  making  use  of 
such  plans.   In  the  larger  metropolitan  areas  vSiere  hospi- 
tal councils  existed,  contact  with  individual  hospitals  was 
made  through  the  coiincil*s  Executive  Director.  Operating 
through  the  Executive  Director  enheuiced  the  conK>ilation  of 
survey  results.   In  the  greater  Pittsburgh  area,  the  per- 
sonal survey  included  visiting  hospitals  with  an  installation 
team  in  order  to  observe  first-hand  the  methodology  involved 
in  setting  up  a  plan  of  job  evaluation. 

Scope  of  study  -  mailed  survey 

In  conjunction  with  the  personal  survey,  a  mailed  sur- 
vey was  undertaken  through  the  Bureau  of  Business  Research  of 
the  Norfolk  College  of  William  and  Mary.  A  four  page  survey 
sheet  and  covering  letter  were  sent  to  all  hospitals  in  the 
continental  United  States  with  200  beds  or  more.  Federal  amd 
State  hospitals  were  excluded  since  each  is  required   to  use 
the  same  Federal  or  State  system  of  evaluation  and  classifi- 
cation.  Tflie  survey  was  confined  to  an  intensive  studjr  of 
hospitals  with  200  or  more  beds  on  the  asstanption  that  larger 
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hospitals  would  be  more  likely  to  have  formal  plams  of  Job 
evaluation  upon  \<hich  wage  administration  rested.  Eight 
hundred  and  fifty-nine  hospitals  meeting  the  above  specifi- 
cations were  included  in  the  mailing.   Suirvey  sheets  were 
mailed  to  both  publicly  gmd  privately  controlled  hospitals 
located  in  every  state.   The  mailed  survey  again  included 
profit  making  as  well  as  non-profit  institutions. 

Of  the  total  number  of  survey  sheets  sent  out,  255 
were  returned  for  a  response  of  approximately  30  per  cent. 
From  this  nuniber,  12  retxirns  were  discarded  for  incomplete- 
ness or  obvious  conflicts.  The  final  number  of  mailed  sur- 
vey sheets  used  in  the  study  was  243.   This  number  plus  the 
60  hospitals  visited  personally  constituted  the  entire 
sample.  The  survey  results  are,  in  most  cases,  based  upon 
the  303  responses  received. 

In  order  to  secure  more  detailed  answers  to  several 
important  questions  on  the  original  survey  sheet,  an  additional 
letter  was  sent  to  each  of  the  38  hospitals  using  a  point 
plan  of  Job  evaluation.   Twenty-three  responses  were  received. 
Of  this  number,  three  were  eliminated  because  of  insufficient 
information.  Answers  given  in  the  remaining  letters  have 
been  incorporated  in  the  svibsequent  analysis  of  hospital  prac- 
tice. A  copy  of  the  original  questionnaire,  the  covering 
letter  and  the  supplemental  letter  are  included  in  Appendices 
A,  B  and  C,  respectively. 
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Results  of  the  Survey 

TTie  necessity  of  creating  techniques  for  handling  the 
problem  of  job  relationships  is  quite  clear;  the  extent  to 
which  such  techniques  have  been  developed  amd  utilized  by 
hospitals  is  not  so  clear.   Results  from  the  aforementioned 
survey  of  hospitals  are  presented  in  order  to  clarify  the 
picture. 

Data  received  from  the  combined  personal  and  mailed 
surveys  will  be  developed  under  the  following  headings s 

1.  General  Observations  from  the  Survey, 

2.  Use  of  the  Local  Hospital  Council  to 
Sponsor  the  Job  Evaluation  Program. 

3.  Status  and  Type  of  Job  Evaluation  Plans 
in  Use  in  Hospitals. 

4.  Securing  and  Developing  Job  Analyses  and 
De  scr iptions . 

5.  Hospital  Usage  of  Community  Wage  Surveys 
in  the  Evaluation  Plan. 

6.  Use  of  a  CcHnmittee  in  Developing,  Installing 
and  Operating  the  Hospital  Job  Evaluation 
Program, 

7.  Responsibility  for  Development  and  Operation 
of  the  Hospital  Job  Evaluation  Plan. 

8.  Securing  Acceptance  of  the  Hospital  Job 
Evaluation  Plan. 

9.  Factors  and  Degree  Values  Used  in  Rating 
Hospital  Jobs. 
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10.  Acceptance  and  Use  of  Simplified  Evalua- 
tion Plans  by  Hospitals. 

11.  Extent  of  Hospital  Usage  of  Reliability 
Checks  on  the  Job  Evaluation  Plan. 

12.  Extent  of  Hospital  Use  of  Validity  Checks 
on  the  Job  Evaluation  Plan. 

13.  Problems  Faced  by  Hospitals  in  O  erating 
and  Controlling  the  Job  Evaluation  Plan. 

General  observations  from  the  survey.   During  the 
course  of  personal  visits  to  many  hospitals,  both  large  and 
small  and  covering  a  wide  geographical  area,  certain  char- 
acteristics and  tendencies  began  to  emerge.   Repeatedly  the 
comment  was  made  "hospitals  are  at  least  ten  to  twenty  years 
behind  times  with  respect  to  many  administrative  and  personnel 
practices."  For  example,  the  personnel  director  of  a  hospital 
employing  soma  950  people,  in  one  of  the  larger  metropolitan 
areas,  commented  that  ten  years  ago  there  were  less  than  five 
hospitals  in  the  city  with  separate  personnel  departments. 
Furthermore,  at  present,  only  about  50  per  cent  of  the  hos- 
pitals in  the  area  had  established  a  personnel  staff.   This 
was  true  despite  the  fact  that  the  size  of  many  of  the  insti- 
tutions in  question  warranted  the  creation  of  an  independent 
personnel  activity. 


^Yoder  suggest  that  a  personnel  ratio  of  .80  is  aver- 
age for  organizations  with  less  than  3000  employees.   See 
Dale  Yoder  and  Roberta  J.  Nelson,  "Industrial  Relations 
Budgets:   Yardsticks  for  1959,"   Personnel,  XXXVI,  No,  4 
(July/August,  1959),  p.  23. 
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Trying  to  deteirmine  vftiy  hospitals  in  general  have 
been  lax  in  developing  more  progressive  administrative  pro- 
grams was  not  an  easy  task.   Responses  were  somewhat  nebu- 
lous. Nevertheless,  emphasis  was  repeatedly  placed  on  the 
fact  that  the  field  of  hospital  administration  was  undoubt- 
edly facing  a  period  of  transition  —  a  change  from  the  "old 
guard"  administrator  with  his  frequent  use  of  rule-of -thumb 
decision  making  techniques  to  the  more  sophisticated  yovmg 
graduates  of  advanced  schools  of  hospital  administration. 
The  impact  of  this  new  group  is  making  itself  felt  in  the 
establishment  and  application  of  more  refined  administrative 
techniques  to  the  organizational  amd  human  relations  problems 
in  the  hospital.  As  was  the  case  in  industjry,  the  chamge 
has  been  gradual.   In  the  interim  period,  a  characteristic 
confusion  prevails  with  the  more  progressive  hospitals  rap- 
idly closing  the  gap  vftiile  other  hospitals  in  the  same  area 
still  cling  to  antiquated  administrative  practices. 

In  repeated  instances  the  responsible  administrative 
authority  suggested  that  job  evaluation  would  not  work  in 
the  hospital  because  of  the  unique  conditions  emd  relation- 
ships which  historically  prevailed.  This  philosophy  seemed 
to  exist  even  in  some  of  the  more  enlightened  areas  of  hos- 
pital administration.  The  editor  of  a  well-known  journal  in 
hospital  administration  suggested  that  "no  one  in  his  right 
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mind  is  prepared  to  come  out  and  say  boldly  that  this  pro- 
fession rates  more  than  that  one  and  this  occupation  should 
be  paid  more  than  another."   It  was  his  further  opinion  that 
"in  most  hospitals,  wage  and  salary  scales  are  kept  secret 
because  of  the  emotion  that  might  be  generated  v*ien  it  is 
discovered  that  a  girl  two  years  out  of  high  school  makes 
more  money  than  a  graduate  nurse  with  a  master's  degree." 
It  is  not  likely  that  the  wage  issue  can  be  kept  secret  for 
any  length  of  time  and,  therefore,  what  is  proposed  as  a 
reason  for  not  using  job  evaluation  actually  becomes  a  strong 
argument  in  its  favor.   In  discussing  this  point,  William  B. 
Schaffroth,  administrator  of  Menorah  Medical  Center  located 
in  Kansas  City,  Missouri,  stated  that  one  of  the  major  crit- 
icisms leveled  at  job  evaluation  was  that  "hospitals  are 
different  and  the  multiplicity  of  occupational  groups  and 

the  complex  functional  and  status  relationship  at  work  make 

2  - 
an  industrial  type  of  wage  administration  impossible."   m 

reply  to  this  issue,  Schaffroth,  who  incidentally  has  estab- 
lished a  very  successful  program  at  Menorah  Medical  Center, 


^Extract  from  a  letter  dated  October  5,  1959,  to  the 
writer  from  Dr.  Charles  U.  Le  Tourneau,  Editorial  Director  of 
the  Journal  Hospital  Management. 

^William  B.  Schaffroth  and  Wayne  D.  Zeller,  "Wage  and 
Salary  Administration,"  Hospital  Managetnent,  UCXXI,  No.  5 
(Mny  1956),  p.  86. 
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made  the  point  that  "the  principles  of  orderly  and  equitable 
procedxires  in  determining  wages  cannot  be  quarreled  withy 
the  details  of •. .applying  job  evaluation  techniques  can   be 
handled  with  regard  for  hospital  customs.  The  difference 
between  most  industries  and  the  hospital  lies  in  the  profes- 
sional groupings,  each  with  its  status  sensitivities,  most  of 
them  setting  themselves  apart  from  the  workman,  many   possessing 
custcsns  and  privileges  with  historical  precedent." 

Perhaps  the  problem  is  over- stated  in  many  cases. 
Actually,  there  exist  definite  status  relationships  in  the 
industrial  situation.   In  addition,  there  are  normally  sev- 
eral factions,  including  professionals,  each  of  vfliich  is 
trying  to  protect  its  own  interests.   To  further  complicate 
the  issue,  most  industrial  firms,  as  contrasted  to  most  hos- 
pitals, are  faced  with  a  group  expressing  collective  demands. 
It  is  difficult  to  conceive  of  the  problems  relating  to  job 
evaluation  in  the  hospital  as  exceeding  those  in  the  indus- 
trial situation.   True,  certain  conditions  are  somewhat 
unique  to  the  hospital,  for  example,  the  discernable  conflict 
between  medical  and  administrative  organization.  However,  the 
problems  once  recognized  are  not  impossible  of  solution, 

^Ibid. ,  p.  88. 
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Notwithstanding  this  recognized  complexity,  consid- 
erable interest  was  e:>^ressed  in  finding  some  more  equitable 
means  of  apportioning  wages.  As  the  administrator  of  a  rela- 
tively new  hospital  of  about  550  employees  emphatically  ex- 
pressed the  idea,  "the  time  has  cone  vAien  we  cannot  rely  en- 
tirely on  informal  rule-of-thunib  methods  of  creating  an  ac- 
ceptable wage  program.   The  complexity  of  the  modern  hospital 
dictates  that  serious  thought  be  given  to  administrative  pro- 
cedures that  have  been  tested  Euid  proven  workable." 

Perhaps  a  major  drawback  to  a  much  greater  acceptance 
of  Job  evaluation  rests  in  the  fact  that,  at  least  for  the 
hospital  field,  little  research  has  been  undertaken.   Conse- 
quently there  is  a  lack  of  reference  material  to  guide  the 
thinking  of  the  administrator.   Furthermore,  although  many 
specific  studies  on  job  evaluation  have  been  made  in  the  in- 
dustrial field  and  even  in  the  areas  of  retailing,  \^ole- 
sallng,  banking  and  insurance,  little  or  nothing  has  been  done 
by  way  of  research  directed  at  extracting  and  applying  the 
more  advanced  methodological  techniques  of  job  rating  to  the 
field  of  hospital  administration.   The  development  of  even 
the  general  principles  of  establishing  proper  job  relation- 
ships has  been  woefully  lacking.  As  an  indication  of  this 
paucity  of  information,  a  considerable  number  of  administra- 
tors, v^en  questioned  about  v^ether  their  institution  made 
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use  of  a  formal  system  of  job  evaluation,  proudly  displayed 
their  merit  rating  program.  This  was  not  only  true  in  the 
personal  interview  but  also  in  the  mailed  survey.  When  con- 
fronted with  a  request  for  literature  explaining  the  plan  of 
job  evaluation,  several  administrators  sent  copies  of  the 
employee  rating  sheet.  Other  interviewees  simply  had  no 
idea  what  was  meant  by  job  evaluation.  Much  remains  to  be 
done  in  bringing  the  idea  to  the  attention  of  those  respon- 
sible for  its  aditiinistration. 

The  personal  visitation  brought  other  serious  prob- 
lem areas  to  light  also.   In  some  instances  exploitation  of 
workers  was  found  to  exist.  For  example,  in  a  medium-sized 
hospital  in  the  Southeast,  the  Personnel  Manager  e3q>lained 
that  his  organization  was  paying  unskilled  help  $20.00  a  week 
for  48  hours  of  work.   In  defense  of  his  position  he  further 
explained  that  another  institution  in  the  same  city  was  pay- 
ing only  $16.00  a  week  for  the  same  ntmiber  of  hours.   In  the 
case  of  the  first  hospital,  indication  was  given  that  one 
meal  per  day  was  added  to  the  compensation.  When  questioned 
further,  it  was  explained  that  the  meal  was  given  to  insure 
that  the  worker  would  be  able  to  stay  on  the  job. 

In  amother  case,  the  Assistant  Administrator  of  a  hos- 
pital employing  some  600  individuals  in  one  of  the  large  metro- 
politan areas  located  in  the  Middle  Eastern  states  stated 
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that  his  hospital  paid  unskilled  labor  slightly  more  than 
$22.00  a  week  for  44  hours.   No  doubt  these  are  extreme 
cases;  however,  such  cases  do  exist.   None  of  the  above  men- 
tioned Institutions  had  taken  any  steps  to  alleviate  the 
situation  through  the  installation  of  a  Job  evaluation  pro- 
gram.  In  both  Instances  cited  above,  the  reason  given  for 
paying  such  a  low  level  of  wages  was  that  the  supply  of  such 
labor  far  exceeded  the  demand.   Perhaps  the  idea  expressed 
by  one  of  the  early  writers  in  the  management  field  deserves 
attention  at  this  point.   It  was  his  opinion  thatx 

To  leave  the  question  of  the  value  of  a 
certain  job  to  the  labor  market  entirely 
(supply  and  demand)  to  take  care  of  it  is 
dead  wrong.   Better  means  to  determine  the 
value  of  a  particular  job  are  necessary, 
and  it  is  only  by  knowing  the  service  ren- 
dered by  it  as  a  productive  unit  that  its 
value  cam  be  determined. 

Evidence  tends  to  confirm  this  view.   If  the  detenninatlon  of 
the  wage  of  unskilled  hospital  labor  were  left  entirely  to 
market  forces,  wages  paid  would  often  be  so  low  as  to  inter- 
fere with  minimum  standards  of  performance. 

The  supply  schedule  of  unskilled  hospital  labor  is 
best  represented  as  perfectly  elastic  within  the  relevant 
range  of  hospital  demand  for  such  labor.   Such  a  supply 


^B.  Gabine,  "Value  and  Application  of  Job  Analysis," 
Industrial  Management.  LXI,  No.  3  (February  1,  1921),  p.  107. 
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schedule  Is  consistent  with  the  report  of  many  administra- 
tors that  they  csm  secure  as  many  vinskilled  workers  as  they 
want  at  the  going  wage  rate  for  that  class  of  labor;  cuid  is 
based  on  the  assumption  that  there  is  a  certain  minimum  wage 
level  below  which  even  unskilled  laborers  will  not  work. 

Given  the  demand  and  supply  schedule  presented  in 
the  diagram  below  administrators  could  hire  ON  workers  at 
the  wage  OW.   Since  only  ON  workers  are  needed,  NN  workers 


O 


no.    of    woiiKer^s 


are  left  vinemployed.  While  the  hospital  need  pay  only  a  wage 
of  OW  to  obtain  all  the  workers  desired,  it  is  contended  that 
the  wage  is  often  too  low  to  be  consistent  with  efficient  per- 
formance.  If  the  price  of  labor  drops  to  the  point  vdiere  the 
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workers  caimot  maintain  their  effectiveness,  management  will 
suffer  the  results  in  decreased  efficiency  of  operations. 
Apparently,  the  government  feels  that  social  legislation  in 
the  form  of  minimum  wages  is  necessary  in  protecting  the  un- 
organized worker  from  the  vagaries  of  the  market.  Conse- 
quently, even  though  the  market  if  not  tampered  with  does 
set  the  price  of  labor,  from  a  management  point  of  view,  good 
practice  would  dictate  the  recognition  of  moral  amd  social  re- 
sponsibility towards  the  worker.  Furthermore,  reducing  wages 
to  the  subsistence  level  does  not  necessarily  reduce  labor 
costs.  Workers  paid  such  a  low  wage  will  find  many  ways  to 
refrain  from  working  or,  at  least,  find  ways  to  work  as 
slowly  and  inefficiently  as  possible.   Such  a  condition  is 
conducive  to  poor  morale.   Consequently,  management  is  faced 
with  problems  v^ich  will  more  than  offset  any  cost  savings 
which  might  be  anticipated  from  paying  subsistence  wages. 

Clearly  such  tactics  as  those  mentioned  above  even- 
tually lead  to  organized  efforts  on  the  part  of  workers  to 
alleviate  the  situation.  Witness  to  this  effort  is  the  rash 
of  attempts  at  \inionizing  v^ich  have  recently  confronted  hos- 
pitals in  many  sections  of  the  country.  Even  the  deep  South 
is  beginning  to  feel  the  pressure.  Only  recently  the 
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Teamsters  Union  launched  a  drive  to  organize  the  non-techni- 
cal employees  of  coianty  hospitals  in  Miami. 

Handicapping  many  union  drives  at  present  is  the 
fact  that  voluntary,  non-profit  hospitals  are  exempt  from 
the  provisions  of  the  Taft-Hartley  Act.  Consequently,  such 

hospitals  need  not  recognize  or  bargain  with  unions  represent- 

2 
ing  the  workers.   In  addition,  memy  state  laws  further  em- 
phasize the  fact  that  such  hospitals  need  not  deal  with 
unions.-'  How  long  these  conditions  will  exist  is  a  matter 
for  conjecture,   several  administrators  in  the  New  York  area 
expressed  belief  that  pressure  was  being  exerted  to  have  the 
restriction  stricken  from  the  state  law.  Although  non-profit 
hospitals  are  not  required  to  deal  with  unions,  many  employees 
still  join  the  union  ramks  in  the  hope  that  sufficient  pres- 
sure might  be  exerted  indirectly  to  achieve  at  least  a  higher 
wage.   Such  was  the  case  in  New  York  City.  One  administrator 
confided  that  he  was  doing  all  in  his  power  to  render  the 


^"Unionizing  Hospitals,"  Wall  Street  Jotumal,  April  2, 
1959,  p.  1. 

^Under  section  2  (2)  of  the  Taft-Hartley  Act,  in 
defining  the  temn  employer,  charitable  hospitals  and  non- 
profit associations  are  eimong  those  employers  excluded  from 
the  Act's  coverage. 

^See  Stephen  J.  Mueller,  Labor  Law  and  Legislation 
(2nd  ed. ;  Cincinnati:   Southwestern  Publishing  Company, 
1956),  pp.  178-182. 
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union  Impotent.   However,  the  collective  action  of  hourly 
paid  vrorkers  had  brought  severe  pressure  £or  wage  increases. 
Indirectly,  and  even  with  the  hospital  refusing  to  recognize 
the  union,  wage  rates  were  forced  upward.   When  the  hospital's 
wage  rates  are  forced  upward  as  a  result  of  union  action,  any 
benefit  that  might  have  come  from  raising  wages  voluntarily 
are  lost.   Employees  will  not  tiry  to  increase  their  producti- 
vity under  such  circumstcmces.  As  a  result,  wage  costs  in- 
crease and  the  resultcmt  antagonism  between  management  and 
labor  remains.  Again,  the  hospital  in  question  had  made  no 
effort  to  create  an  equitable  internal  wage  structure  based 
upon  Job  evaluation.  As  a  matter  of  fact,  only  one  of  the 
hospitals  visited  in  metropolitan  New  York  had  installed  a 
Job  evaluation  plan,  and  in  this  instance  the  plan  was  not 
installed  until  after  the  effort  was  made  to  unionize  its 
employees.   This  laxity  on  the  part  of  New  York's  hospitals 
was  at  least  partially  responsible  for  the  serious  labor  dis- 
turbances which  plagued  them  during  1959. 

The  idea  of  hospital  unionization  is  drawing  increased 
attention  from  administrators.   In  nearly  evej^^  case,  low 


^See  the  April  2,  1959,  issue  of  the  Wall  Street 
Journal  for  a  complete  story  of  the  attempt  by  three  sep- 
arate unions  to  unionize  more  than  30,000  non-professional 
employees  in  New  York's  non-profit  hospitals. 
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wages  seemed  to  be  central  to  the  issue.   In  giving  advice 

to  the  hospital  facing  union  organization,  Raymond  Farwell, 

administrator  of  Swedish  Hospital  in  Seattle,  made  the 

following  point: 

Make  sure  that  your  own  position  is 
defensible  from  the  standpoint  of  the 
wages  and  working  conditions  for  hos- 
pital employees.   If  the  unions  have 
nothing  to  sell  in  the  way  of  real  im- 
provement for  yoxor  employees,  they  will 
not  be  aible   to  recruit  any  substantial 
number  of  members. 

Essentially  the  same  idea  was  expressed  by  Donald  Wood, 

Executive  Director  of  the  Twin  City  Regional  Hospital 

Council  of  St.  Paul-Minneapolis: 

A  very  important  factor  in  the  organi- 
zation of  an  employee  group  is  that  of 
the  standards  of  employment  that  exist... 
Do  they  at  least  meet  standards  of  wages 
and  fringe  benefits  in  the  community  -- 
wages  and  fringe  benefits  for  like  jobs 
and  like  employment?2 

With  regard  to  fringe  benefits  of  the  special  type 

that  have  historically  been  considered  necessary  in  many 

hospitals  (meals,  room  and  board,  uniforms,  etc.)  the 

trend  appears  to  be  changing.  Almost  without  exception 

administrators  and  personnel  memagers  reported  a  definite 


•'•Raymond  F.  Farwell,  "The  Hospital's  Side  of  a 
Hospital  Strike, "  The  Modem  Hospital,  LIXIII,  No,  1 
(July  1959),  p.  67. 

^Wood,  op.  cit.,  p.  74. 
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decline  In  the  use  of  payments  In  kind  with  a  consequent 
Increase  In  cash  payments  for  work  accomplished.   This 
change  will  definitely  accentuate  the  wage  problem  both 
In  terms  of  the  necessity  of  meeting  the  coramtinlty  wage 
level  as  well  as  the  need  for  establishing  more  valid 
inter- job  rates  since  more  direct  wage  comparison  Is 
possible. 

Use  of  local  hospital  co\ancil  to  sponsor  job  eval- 
uation program.  One  of  the  most  unique  and  potentially 
useful  programs  discovered  during  the  personal  survey  was 
the  use  of  the  local  Hospital  Council  to  sponsor  the  job 
evaluation  progreun.  Basically  it  "represents  the  first 
attempt  to  obtain  the  benefits  of  scientific  management  for 
a  large  group  of  hospitals  in  a  single  geographical  area." 
The  program  was  initiated  by  the  Council  after  extensive 
expressions  of  interest  were  forthcoming  from  member  hos- 
pitals. A  foundation  grant  provided  sufficient  funds  to 
cover  the  initial  or  "tooling  up"  phase  of  the  program  as 
well  as  the  necessary  working  capital.  After  a  short  inter- 
val of  time,  the  program  was  shifted  to  a  fee-for-service 
basis  and  became  entirely  self-supporting. 


^Quoted  from  a  directive  published  by  the  Western 
Pennsylvania  Hospital  Council  to  be  sent  to  all  hospital 
members  of  the  Council. 


87 

The  plan  involved  a  systematic  three-stage  approach 
directed  primarily  at  increasing  hospital  efficiency 
through  the  development  euid  implementation  of  more  up-to- 
date  management  techniques  and  procedures.   It  was  felt 
that  since  the  hospital  was  a  high  labor  cost  operation,  an 
attempt  to  eliminate  waste  and  inefficiency  in  this  area 
offered  the  best  hope  for  reducing  costs.   Interestingly 
enough,  although  the  program  eventually  intended  to  make 
use  of  methods  engineering  and  improvements,  it  was  the 
area  of  wage  and  salary  administration  that  received  first 
consideration. 

The  first  stage  of  the  program  was  devoted  to  the 
design  amd  development  of  a  Job  evaluation  program  which 
was  installed  in  three  "pilot"  hospitals.  The  Council 
brought  in  three  analysts,  each  of  whom  was  experienced 
in  hospital  job  evaluation,  plus  two  office  workers.  With 
the  assistance  of  a  management  consulting  fiina,  the  ana- 
lysts carried  out  the  initial  stage.  This  first  part  of 
the  program  was  of  four  months  duration  during  which  time 
procedures  were  refined  and  experience  gained  so  that  the 
Council  staff  of  three  members  could  assiune  entire  respon- 
sibility for  the  remainder  of  the  program. 

Stage  two  is  still  in  process  of  accomplishment. 
It  entails  the  establishment  of  "tailor-made"  job  evaluation 
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programs  in  each  of  the  Coxmcil's  member  hospitals  on  a 
request- for- service  basis.   It  is  importamt  to  recognize 
that  a  rigid  pattern  of  wages  is  not  forced  on  all  hos- 
pitals in  the  area.   In  the  first  place,  all  position  de- 
scriptions and  evaluations  and  the  resulteuit  salary  classi- 
fication plan  are  all  specifically  designed  to  meet  actual 
conditions  existing  in  the  individual  hospital.   The  only 
stamdardization  in  the  project  relates  to  procedures  for 
carsrying  out  the  survey  work  and  the  job  evaluation  plan 
used.  And,  secondly,  participation  in  the  program  is  purely 
voluntary.   Stipulation  has  been  made  that  work  would  be 
limited  to  those  hospitals  that  were  prepared  to  make  use 
of  the  work  done  by  the  project  staff.   Under  such  re- 
strictions, inter-hospital  salary  stamdardization  is  hardly 
possible.  An  integral  part  of  the  installation  of  the  pro- 
gram in  each  hospital  is  the  training  of  a  coordinator  from 
the  participating  hospital.  As  a  result,  once  the  team  has 
completed  its  mission,  the  hospital  will  have  an  experienced 
individual  vAio  can  be  charged  with  the  responsibility  of 
maintaining  the  newly  installed  plan  on  a  day-to-day  opera- 
tional basis.   Part  of  the  training  involved  the  constant 
participation  of  the  coordinator  in  the  establishment  and 
installation  of  the  job  evaluation  plan  in  his  hospital. 
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Once  the  vrage  euid  salary  program  is  properly  estab~ 
llahed.  It  is  e3cpected  that  stage  three  vd.ll  be  put  into 
operation  as  a  natural  outgrowth  of  the  two  preceeding 
stages.  This  particuleir  phase  of  the  program  will  see 
emphasis  shifted  to  management  audits  amd  methods  improve- 
ment projects  among  participating  hospitals  in  order  to 
achieve  increased  efficiency  in  hospital  management.   It 
is  expected  that  an  automatic  demand  for  stage  three  will 
be  created  during  the  implementation  of  stage  t%«o  as  the 
hospitals  began  to  apply  and  evaluate  the  results  of  the 
job  evaluation  work. 

Perhaps  the  most  importsmt  result  of  this  "group 
concept"  is  the  reduction  in  cost  of  installing  a  tailor- 
made  job  evaluation  plan  in  the  participating  hospitals. 
The  cost  differential  between  having  an  outside  consultant 
perform  the  work  on  an  individual  hospital  basis  and  having 
the  same  job  accomplished  through  the  council  ran  as  high 
as  80  per  cent.   This  significant  reduction  in  cost  places 
this  particular  management  technique  at  the  disposal  of 
most  hospitals.  Furthermore,  it  is  expected  that  the  results 
achieved  by  the  Council  staff  group  might  well  be  superior 
to  that  accomplished  by  an  outside  agency.   It  is  obvious 
that  much  valuable  information  and  experience  can  be  gleaned 
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by  the  Council  group  inasmuch  as  all  of  their  efforts  are 
confined  to  hospitals  with  their  specialized  and  unique 
problem  areas.   On  the  other  hand,  an  outside  agency  might 
not  have  sufficient  experience  in  the  hospital  field. 
Since  the  interrelationships  that  exist  in  the  hospital  are 
considered  to  be  different  from  the  industrial  situation, 
difficulties  might  be  incurred.  And,  finally,  althou^ 
salary  standardization  is  not  the  purpose  of  the  program,  a 
gradual  process  of  standardizing  salaries  in  the  local 
Co\mcil*s  area  might  well  be  established  on  a  voluntary 
basis,   such  a  result  could  substantially  reduce  the  per- 
sonnel problem  of  employee  transfers  among  hospitals  be- 
cause of  wage  differentials. 

Status  and  type  of  lob  evaluation  plans  in  use  in 
hospitals.   In  order  to  obtain  a  better  understanding  of 
the  place  job  evaluation  fills  in  the  hospital's  wage  pro- 
gram, it  is  necessary  to  look  more  closely  at  the  specific 
results  of  the  survey  findings.   The  material  presented  here 
represents  a  general  picture  of  the  status  of  formal  Job 
evaluation  in  the  hospital  field.   It  is  not  intended  to 
reflect  on  any  individual  institution.   Individual  inter- 
pretations are  made  with  this  point  in  mind.   The  results 
are  based  entirely  on  survey  findings.   In  an  effort  to 
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discover  as  many  hospital  Job  evaluation  plans  as  possible, 
the  survey  Included  primarily  those  hospitals  which  were 
more  likely  to  have  such  plans  In  operation.  Consequently, 
it  is  likely  that  the  results  present  an  over-statement 
rather  than  an   understatement  of  the  extent  to  which  job 
evaluation  systems  are  used  by  hospitals. 

Keeping  in  mind  the  possible  limitations  mentioned 
above,  it  can  be  stated  with  reasonable  certainty  that  at 
present  a  sizeable  segment  of  the  hospital  field  has  not 
developed  formal  Job  evaluation  techniques.   In  the  mailed 
svirvey,  only  34  per  cent  of  the  hospitals  contacted  had 
established  formal  Job  rating  techniques.  The  personal 
survey  revealed  even  a  smaller  percentage  (23  per  cent)  of 
hospitals  currently  using  a  formal  evaluation  plan  (see 
Table  4) .   This  is  a  poor  showing  Indeed  when  compared  to 
the  high  percentage  of  industrial  concerns  presently 
making  use  of  Job  rating  in  developing  a  more  equitable 
wage  program.   However,  there  seems  to  have  been  a  recent 
awakening  on  the  part  of  administrators  to  the  desperate 
need  for  such  a  tool  to  guide  in  wage  decisions.  This  is 
evident  from  the  fact  that  vflien  the  two  surveys  are 


"Job  Evaluation;  A  Survey  of  Company  Practices," 
Btenaqement  Review,  XLIII,  No.  11  (November  1954),  pp.  732- 
733. 
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ccmOained,  more  than  42  per  cent  of  the  respondents  indi- 
cated that  they  were  either  in  the  process  of  installing  a 
formal  system  or  were  contemplating  the  development  and 
implementation  of  such  a  plan  in  the  very  near  futxire. 

TABLE  4 
PRESENT  STATUS  OF  JOB  EVALUATION  IN  HOSPITALS 


ass-BsaaBSsKS^KKsa^B 

Mailed 

Survey 

Personal  Survey 

Item 

Ntimber 

Per  Cent 

Number 

Per  Cent 

NO  formal  program  and  no 
plan  to  install 

49 

20 

28 

47 

Formal  program  now  in 
effect 

84 

34 

14 

23 

Installing  formal  plan 
at  time  of  survey 

43 

18 

2 

3 

Planning  to  install 

formal  plan  in  near 
future 

67 

28 

16 

27 

Totals 

243 

100 

60 

100 

Source:  Hospital  Job  Evaluation  Survey. 


In  hospitals  with  job  evaluation  plans  covering  be- 
tween 100  to  2000  employees,  the  point  system  predominated. 
This  is  in  keeping  with  the  trend  in  industrial  and  service 
organizations.   The  basic  importance  of  the  point  plan  is 


^"Job  Evaluation;  A  Survey  of  Company  Practices, 
Management  Review,  XLVI,  No.  4  (April  1957),  pp.  42-44. 
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that  it  leads  to  more  logical  development  of  an  adequate 
wage  structure.   In  addition,  experience  with  usage  of  the 
point  plan  in  hospitals  has  suggested  that  "the  point 
scoring  method  is  more  objective  than  other  plans.   It  not 
only  furnishes  a  more  adequate  yardstick  for  establishing 
wage  and  salary  differentials  in  a  single  hospital,  but  it 
also  facilitates  job  and  rate  comparisons  between  hospitals 
in  any  city  or  geographical  area." 

In  addition,  the  point  plan  renders  more  practical 
scientific  approaches  to  proving  the  worth  of  the  system. 
At  best  job  evaluation  tends  to  be  subjective  in  nature 
and,  without  verification  as  to  validity  and  reliability, 
results  might  well  prove  of  negative  value.  At  least  with 
respect  to  validity,  quantitative  data  are  necessairy  in  the 
development  of  program  checks;  such  quantitative  data  are 
more  readily  discernible  in  the  point  plan  ratings. 

In  the  present  survey,  considering  both  "plans  in 
effect"  and  "plans  being  installed, "  in  hospitals  with  up 
to  2,000  covered  employees,  61  (43  per  cent)  institutions 
reported  use  of  a  point  plan.  Two  hospitals  with  more  than 
2,000  covered  employees  also  indicated  use  of  a  point  plan 


•'■Robert  A.  Bradburn,  "Job  Evaluation  Answers  the 
65  Cent  Question  for  Hospitals,"  Hospitals,  XXXI  (August  16, 
1957),  p.  31. 
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(see  Table  5).   Within  the  same  remge  of  covered  employees 


TABLE  5 

DISTRIBUTICaj  OF  FORMAL  HOSPITAL  JOB  EVALUATION  PLANS 
BY  TYPE  (COMBINED  SURVEY  RESULTS) 


Type  of  Plan 

Job  Evaluation 
Plans  in  Effect 

Job  Evaluation 
Plans  Being 
Installed 

Planning  to 

Install  Job 

Evaluation 

Ranking 

Classification 

Point 

Factor  Comparison 

Combination 

No  type  indicated 

21 

33 

38 

2 

4 
0 

4 
8 
25 
3 
2 
3 

7 
2 
9 
3 
0 
62 

Totals 

98 

45 

83 

Source:   Hospital  Job  Evaluation  Survey 


(up  to  2,000),  the  classification  plan  was  reported  in  use 
in  37  (11  per  cent)  hospitals.   In  addition,  four  large 
institutions  of  over  2,000  employees  made  use  of  a  classif- 
ication plan.   It  is  interesting  to  note  that  all  four 
hospitals  were  operated  by  a  county  or  city  government 
both  of  v^iich  tend  to  lean  toward  classification  plan  as 
does  the  federal  government.  Another  interesting  fact  is 
that  one  hospital  with  over  2,000  covered  employees  and 
eleven  hospitals  with  between  500  and  2,000  covered 
employees  made  use  of  a  simple  system  of  ranking  jobs.   For 
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the  larger  institutions  this  would  mean  a  minirnum  of  from 
200  to  400  different  Jobs.   It  is  difficult  to  envision 
the  creation  of  internally  consistent  job  relationships 
based  upon  a  simple  ranking  of  this  many  jobs.   It  is 
vinlikely  that  any  one  individual  or  even  a  conmiittee  would 
have  sufficient  knowledge  of  each  job  to  be  able  to 
properly  value  it  in  relation  to  all  other  jobs. 

In  general,  hospital  administration  has  been  rather 
slow  in  adopting  job  rating  as  a  means  of  lifting  the  wage 
program  out  of  the  realm  of  sheer  guesswork.   Support  for 
this  view  is  found  in  the  fact  that  65  per  cent  of  the  plans 
reported  in  operation  at  present  have  been  installed  since 
1955  (see  Table  6) .   Over  85  per  cent  have  been  developed 
In  the  past  ten  years.  Contrasted  to  this  relatively  re- 
cent establishment  of  formal  job  rating  procedxires  by  hos- 
pitals, an  early  study  emanating  from  the  Personnel  Depart- 
ment of  Purdue  University  reported  that  one-half  of  63 
industrial  organizations  contacted  had  established  a  formal 
job  evaluation  plan  prior  to  1938. 

For  those  hospitals  currently  reporting  the  use  of 
formal  job  evaluation,  there  was  little  uniformity  with 


^H.  B,  Rogers,  "What's  Your  Job  Worth,"  Iron  Age. 
CXLIV,  NO.  7  (August  17,  1939),  p.  43, 
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TPlBUE   6 


YEAR  OF  ESTABLISHMENT  OF  HOSPITAL  JOB  EVALUATION  PIANS 

(COMBINED  SURVEY  RESULTS) 


Nxiinber  of  Plans 

Number  of  Plems 

Year 

Established 

Year 

Established 

1960 

4 

1954 

5 

1959 

6 

1953 

3 

1958 

9 

1952 

4 

1957 

13 

1951 

5 

1956 

11 

1950 

3 

1955 

1 

Before 
1950 

14 

Total 

98 

Source:  Hospital  Job  Evaluation  Survey, 


respect  to  the  time  required  to  install  the  plan.  Unless 
there  is  undue  delay,  a  formal  plan  of  evaluation  should  not 
take  longer  than  a  year  to  develop  and  implement.  With  few 
exceptions  this  proved  to  be  the  case  in  the  establishment 
of  plans  in  hospitals.  As  a  matter  of  fact  67  hospitals, 
or  approximately  69  per  cent  of  those  reporting  the  use  of 
such  plans,  indicated  a  time  for  program  development  of  a 
year  or  less  (see  Table  7).  Of  this  nmnber,  43  hospitals 
(47  per  cent)  took  from  six  to  twelve  months  to  develop 
and  install  their  plan.   The  one  possible  exception  to  the 
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general  pattern  vrais  the  fact  that  seven  of  the  point  plams 
of  Job  evaluation  took  from  13  months  to  two  yeeurs  or  more 
to  complete.  This  perhaps  would  serve  to  indicate  the 
recognized  complexity  associated  with  the  point  system  of 
evaluation. 

TABLE  7 

LENGTH  OF  TIME  REQUIRED  TO  INSTALL  HOSPITAL 
JOB  EVALUATION  PLANS  BY  TYPE 
(COMBINED  SURVEY  RESULTS) 


Factor 

Classifi- 

Compari- 

Combi- 

Time Required 

Raxiking 

cation 

Point 

son 

nation 

Less  than  6 

months 

6 

5 

8 

1 

1 

6  to  12  months 

6 

16 

20 

1 

3 

13  to  24  months 

2 

2 

6 

0 

0 

25  months  or 

more 

1 

0 

1 

0 

0 

No  answer 

6 

10 

3 

0 

0 

Totals 

21 

33 

38 

2 

4 

Source:  Hospital  Job  Evaluation  Survey. 


Securing  and  developing  job  analyses  and  descriptions. 
Job  evaluation  is  based  upon  facts  obtained  through  job 
analysis  and  resultant  descriptions  and  specifications.  As 
a  matter  of  fact,  one  of  the  most  important  activities 
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preparatory  to  Implementing  a  Job  evaluation  program  Is 
the  Job  analysis.  Without  the  information  contained  in 
the  descriptions  and  specifications  it  becomes  virtually 
impossible  to  accomplish  a  complete  and  \inbiased  rating  of 
Jobs.   This  is  especially  true  v^ere  the  more  quantitative 
systems  of  evaluation  are  in  use  and  v/here  major  emphasis 
is  placed  upon  the  written  description  rather  than  a  per- 
sonal inspection  of  the  Job  for  rating  purposes. 

Although  Job  analysis  and  descriptions  are  funda- 
mental to  proper  operation  of  the  hospital  personnel  pro- 
gram, little  more  than  31  per  cent  of  the  hospitals  con- 
tacted indicated  that  they  had  conducted  Job  analyses  and 
established  descriptions  for  all  positions  in  the  organi- 
zation (see  Table  8),  According  to  Lytle,  this  figure  is 
extremely  low  v^en  compared  to  the  early  and  extensive 
development  of  complete  Job  analyses  by  most  industrial 
concerns. 

Twenty-one  per  cent  of  the  respondents  reported 
that  no  attempt  had  been  made  to  write  descriptions  for  any 
of  the  Jobs  in  the  hospital.   With  the  exception  of  ten 
units  which  did  not  answer  the  question,  the  remaining 
hospitals  (45  per  cent)  reported  that  such  written 


^Lytle,  op.  cit.,  pp.  128-132. 
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TABLE  8 

NUMBER  OF  HOSPITALS  REPORTING  USE  OF  JOB  ANALYSES 
AND  DESCRIPTIONS  FOR  ALL  HOSPITAL  JOBS 
(COMBINED  SURVEY  RESULTS) 


Item 

Frequency  of  Responses 

Nvunber 

Per  Cent 

Yes 
No 

Partial 
No  answer 

95 

63 

135 

10 

31 

21 

45 

3 

Total 

303 

100 

Source:  Hospital  Job  Evaluation  Survey < 


information  had  been  secured  for  at  least  part  of  the  jobs 
in  their  particular  unit.  However,  closer  examination  re- 
vealed that  in  many  cases  the  partial  descriptions  were 
for  the  professional  groups  —  principally  nvirsing  —  and 
had  been  extracted  from  infojnnation  supplied  through  the 
relevamt  professional  organizations.   Since  Jobs  with  the 
same  title  and  even  the  same  general  duties  vary  from 
organization  to  organization,  this  does  not  represent  an 
acceptable  procedure.  One  hospital  contacted  used  a  rather 
unique  modification  of  this  approach  which  tended  to  modify 
this  criticism  somewhat.  Each  employee  was  given  a  copy  of 
the  description  of  his  job  as  contained  in  the  United  States 


100 
Employment  Service's  mamual  Job  Descriptions  and  Occupa- 
tional Analysis  for  Hospitals  and  Related  Health  Services. 
The  employee  was  requested  to  make  additions,  deletions 
and  changes  in  the  job  description  given  him  so  that  it 
described,  to  his  satisfaction,  the  Job  he  was  performing. 
Again,  without  adequate  checks  on  the  resultant  description, 
this  does  not  represent  an  acceptable  procedure. 

The  major  difficulty  expressed  by  those  who  had 
iindertaken  a  Job  analysis  and  written  descriptions  was  the 
"lack  of  time  and  personnel  to  keep  on  top  of  descriptions.** 
A  question  regarding  the  frequency  of  review  of  Job 
descriptions  was  not  included  in  the  mailed  surveys  how- 
ever, such  a  question  was  asked  of  all  respondents  in  the 
personal  survey.   With  few  exceptions  the  answer  was  "as 
needed.**   The  impression  given  was  that  "as  needed"  really 
meant  seldom  if  ever.   For  exaunple,  one  administrator,  upon 
being  questioned  on  this  point,  opened  his  desk  drawer, 
withdrew  a  stack  of  yellowed  Job  descriptions  and  threw 
them  on  the  desk  with  the  comment  '*a  good  deal  of  expense 
and  time  went  into  the  preparation  of  these  descriptions 


U.  s.  Department  of  Labor,  Bureau  of  Employment 
Security,  Job  Descriptions  and  Occupational  Analysis  for 
Hospitals  and  Related  Health  Services  (Washington: 
U.  S,  Government  Printing  Office,  1952) . 
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six  years  ago  and  they  haven't  been  revievred  or  reworked 
since.   It  was  a  waste  of  time  as  the  work  of  the  consultant 
hasn't  been  followed  up,"  This  did  not  represent  an  iso- 
lated incident.  Essentially  this  same  comment  was  heard 
repeatedly.  Descriptions  should  be  periodically  revised 
in  order  to  keep  abreast  of  job  modifications  or  other 
changes  in  Job  content.   Since  Job  content  is  the  basis 
for  pricing  the  Job,  any  significant  change  in  its  content 
will  necessitate  revaluing  the  Job. 

Another  difficulty  encountered  was  the  variability 
of  Job  descriptions.   In  order  to  do  an  effective  Job, 
descriptions  must  be  complete  and,  either  internal  to  the 
description  or  supplement  airy  to  it,  there  must  exist  a  Job 
specification  —  the  requirements  necessary  to  successful 
execution  of  the  Job,  Furthermore,  it  is  necessary  that 
the  description  be  written  in  terms  that  explain  and 
facilitate  the  measurement  of  factors  on  which  the  Job  is 
to  be  rated.   In  general,  the  more  detailed  and  complete 
the  descriptions,  the  greater  the  reliance  that  can  be 
placed  on  rating  results  and  the  higher  will  be  the  validity 
and  reliability  of  the  program.   Seunple  descriptions  were 
requested  from  respondents.  The  descriptions  returned 
rsmged  all  the  way  from  a  single  paragraph  covering  less 
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than  one-half  a  page  to  three  pages  of  material.   This 
degree  of  variation  was  Incurred  on  descriptions  for  the 
saune  lob  In  different  hospitals.   In  each  case,  the 
description  vas  to  be  used  to  rate  jobs  under  a  point 
plan  of  evaluation. 

When  questioned  regarding  the  methodology  of 
securing  Information  In  those  cases  where  job  descriptions 
were  used,  respondents  Indicated  that  the  principal  means 
employed  was  the  personal  Interview  plus  a  questionnaire 
f rc»i  the  employee  concerned  (see  Table  9) .   Inasmuch  as 

TABLE  9 

METHODS  EMPLOYED  BY  HOSPITALS  TO  SECURE 
INFORMATION  FOR  JOB  DESCRIPTIONS 
(COMBINED  SURVEY  RESULTS) 

Method  Employed  Responses 

Interview  and  questionnaire  from  employee  47 
Supervisor  or  department  head  Interviewed  on 

the  job  44 
Interview  and  questionnaire  from  supervisor  or 

department  head  34 

Employee  interviewed  on  the  job  32 

Questionnaire  filled  in  by  employee  19 
Questionnaire  filled  in  by  supervisor  or 

department  head  13 

Job  description  manual  2 

Survey  by  assistant  Personnel  Director  1 


Total  192^ 

Source  I  Hospital  Job  Evaluation  Survey. 

^Greater  than  total  of  formal  plans  in  effect  plus 
those  in  process  of  installation  because  some  hospitals  indi- 
cated more  than  one  method. 
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employee  participation  is  of  such  consequence  in  securing 
complete  understanding  and  acceptance  of  the  plan,  it 
would  appear  that  a  most  acceptable  procedure  is  being 
practiced.^  The  second  most  important  technique  employed 
was  to  interview  the  supervisor  or  department  head  con- 
cerning jobs  under  their  jurisdiction. 

Further  analysis  revealed  that  in  only  a  small 
nuniber  of  instauices  were  both  methods  employed  simultane- 
ously; that  is,  involving  both  the  employee  and  the  super- 
visor in  the  information  gathering  project.   Survey  results 
suggest  that  in  a  great  many  instances  only  the  supervisor 
is  involved  in  supplying  job  information.  The  employee  is 
closer  to  his  job  than  anyone  else  and,  consequently,  knows 
more  about  each  facet  of  the  activity.   This  job  knowledge 
makes  it  desirable  that  job  infoxnnation  be  secured  from 
the  employee  with  the  advice  and  assistance  of  his  super- 
visor.  In  many  instemces  hospitals  have  failed  to  make  use 
of  this  technique  as  a  means  of  involving  both  the  employee 
and  his  supervisor  in  the  program. 


^This  approach  is  significantly  different  from  that 
uncovered  by  a  survey  of  department  store  practices  in  job 
evaluation.   In  this  study,  most  of  the  descriptions  were 
secured  by  interviewing  the  supervisor  or  by  interviewing 
the  employee  on  the  job.   In  this  situation  the  employee 
had  no  chance  to  put  in  writing  his  estimate  of  \^at  con- 
stituted his  job.  William  R.  spriegel  amd  Elizabeth  Lanham, 
Job  Evaluation  in  Department  Stores  (Austin,  Texas t  Univer- 
sity of  Texas,  Bureau  of  Business  Research,  1951),  p.  89. 
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As  an  example  of  this  lade  of  under steinding  of  the 
importance  of  participation  in  program  development,  the 
writer,  in  interviewing  the  assistant  personnel  director 
of  a  large  metropolitcUi  hospital,  was  told  that  the  hos- 
pital had  just  paid  a  large  s  ti  to  have  a  well-known  con- 
sulting firm  perform  a  job  analysis  and  evaluation.  In 
securing  job  information  to  be  used  in  the  description  not 
a  single  employ(*e  had  been  contacted.  All  job  information 
had  come  from  either  the  department  head  or  supervisor 
concerned.   In  this  connection,  it  is  interesting  to  note 
that  the  survey  results  revealed  that,  in  all  but  three 
cases,  those  respondents  v*iich  indicated  that  their  plan 
was  either  satisfactory  or  highly  satisfactory  also  indi- 
cated that  employee  participation  was  a  fundamental  part 
of  the  plan. 

In  an  overwhelming  majority  of  cases  (71  per  cent), 
final  job  descriptions  were  approved  by  the  department  head 
in  question  (see  Table  11).   If  the  supervisor  is  included, 
93  per  cent  of  final  descriptions  are  approved  by  the 
superior.  This  follows  accepted  practice;  however,  few 
hospitals  have  apparently  undertaken  to  allow  the  employee 
at  least  a  cvirsory  approval  of  the  final  description  from 
which  the  rating  will  be  done.   Less  than  8  per  cent  of 
those  responding  suggested  that  the  employee  be  given  at 
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least  the  chance  to  view  euid  verify  the  final  description 
of  the  work  which  he  is  performing. 

TPiBLE   10 

PERSONS    RESPONSIBLE  FOR  WRITING  JOB 

DESCRIPTIONS  FOR  THE  HOSPITAL 

(COMBINED  SURVEY  RESULTS) 

Responsible  Party  Responses 

Supervisors  or  Department  Heads  41 

Employees  15 

Employees  plus  Department  Heads  11 

Hospital  Covmcil  Staff  7 

Personnel  Director  5 

Administrator  3 

Department  Head  plus  Personnel  Director  2 

Civil  Service  Commission  2 

Assistant  Administrator  2 

Analyst  plus  Department  Head  2 

Job  Analyst  2 

Consultant  plus  Personnel  Director  1 

Consultant  plus  Department  Head  1 

Department  Head  plus  State  Personnel  Department  1 

Department  Head  plus  Committee  1 

No  answer  47 


Total  143* 

Source:  Hospital  Job  Evaluation  Survey. 

^Includes  plans  in  effect  plus  those  in  process  of 
being  installed. 
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TABLE  11 


PERSON  INVOLVED  IN  FINAL  APPROVAL  OF  HOSPITAL  JOB 
DESCRIPTIONS  (Mailed  Survey  Results  Only) 


Item 

Frequency  of  Responses 

Number 

per  cent 

Department  Head 

Supervisor 

Employee 

174 
53 
16 

71 

22 

7 

Total 

243 

100 

Sources  Hospital  Job  Evaluation  Survey, 


Hospital  use  of  community  vraiqe  surveys  in  the  eval- 
uation plan.   It  is  evident  that  the  successful  adminis- 
tration of  job  evaluation  requires  sufficient  information 
on  competitive  rates  to  keep  the  hospital's  wage  and  salary 
program  in  the  desired  relationship  to  going  rates  in  the 
community  and/or  labor  market  from  vSiich  it  must  draw 
employees.   The  acquisition  of  labor  market  job  rates  at 
least  for  key  jobs  is  also  necessary  in  the  validation  pro- 
cess during  the  latter  stages  of  program  development.   It  is 
inconceivable  that  a  workable  and  effective  plan  should  be 
based  on  other  than  a  valid,  continuing  wage  survey.   Of  the 
total  number  of  hospitals  questioned,  all  but  32  (11  per  cait) 
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made  use  of  some  type  of  community  wage  survey  in  helping 
to  set  wage  rates  (see  Table  12).   This  niunber  included 
both  those  hospitals  with  eind  without  a  formal  job  evalu- 
ation plan.   In  some  cases,  hospitals  without  a  formal  plan 
have  established  a  rather  complete  program  of  surveying 
hospital  wage  rates;  however,  it  must  be  remembered  that 
the  wage  survey,  no  matter  how  good,  is  merely  a  supple- 
mentary tool  of  the  job  evaluation  plctn  and  in  no  wise  is 
intended  to  supplant  it. 

TABLE  12 

EXTENT  OF  HOSPITAL  USAGE  OF  COMMUNITY  WAGE 
SURVEYS  IN  SETTING  WAGE  RATES 
(COMBINED  SURVEY  RESULTS) 


Frequency 

of  Responses 

Item 

Number 

Per  Cent 

Use  Community  Wage  Surveys 
Do  not  use  Community  Wage 
Surveys 

271 
32 

89 
11 

Total 

303 

100 

Source:  Hospital  Job  Evaluation  Survey, 


In  view  of  the  recognized  need  for  a  continuing  pro- 
gram of  rate  reviews,  it  is  necessary  that  a  formal  and 
specific  progreun  of  surveying  community  wages  be  established. 
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In  this  area,  either  because  of  lack  of  time  or  failure  to 
fully  recognize  the  problem,  hospitals  in  general  are  woe- 
fully deficient.   Of  all  the  hospitals  queried,  less  than 
one-third  regularly  undertook  an  established  program  of 
surveying  ^tfages  (see  Table  13).   This  pattern  was 

TABLE  13 

FREQUENCY  OF  HOSPITAL  WAGE  SURVEYS 
(COMBINED  SURVEY  RESULTS) 


Item 


Frequency  of  Responses 


Semi-annual ly 

Annually 

As  needed 

Other 

No  answer 


Total 


Source:   Hospital  Job  Evaluation  Survey, 


considerably  changed,  however,  When  only  those  hospitals 
which  have  instituted  a  point  plan  of  job  evaluation  were 
considered.   Of  the  38  plans  reported,  ten  hospitals 
(27  per  cent)  indicated  use  of  a  semi-annual  wage  survey, 
13  (34  per  cent)  reported  annual  surveys  on  wages,  14  (35 
per  cent)  specified  that  wage  surveys  were  taken  "as 
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needed"  and  one  did  not  respond  to  the  question.  This 
represents  a  considerable  advancement  over  the  record  of 
hospitals  as  a  vAiole  (see  Table  12).  Nevertheless,  there 
is  still  considerable  room  for  improvement. 

Since  one  of  the  most  serious  difficulties  in  the 
proper  establishment  of  relative  v/ages  between  jobs  may 
result  from  usage  of  job  titles  only,  hospitals  were 
queried  on  vfliether  wage  information  was  sought  on  the 
basis  of  job  titles  alone.  Considering  the  entire  sample 
of  hospitals  (303),  approximately  one-half  (51  per  cent) 
gave  indication  of  recognition  of  the  problem  and  conse- 
quently made  use  of  descriptions  rather  than   titles  alone 
in  gathering  wage  information.  However,  a  large  group 
(35  per  cent)  stated  that  job  titles  alone  were  used  (see 
Table  14) .   In  view  of  the  recognized  possibility  of  dis- 
parity between  job  titles  and  actvial  job  content  from 
organization  to  organization,  from  the  point  of  view  of 
what  is  considered  sound  practice  this  lack  of  action  con- 
stitutes a  serious  omission  and  might  well  lead  to  inval- 
idation of  the  entire  wage  program.  Again,  in  comparing 
the  38  point  plans  reported  in  operation  with  the  above 
figures,  31  hospitals  (82  per  cent)  reported  use  of  job 
descriptions  in  securing  wage  information  vdiereas  only  six 
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(16  per  cent)  stated  that  job  titles  alone  were  used.   One 
hospital  failed  to  respond  to  the  question.   Here  again 
users  of  point  plans  appeared  to  recognize  the  value  of 
talcing  an  approach  to  securing  wage  information  vAiich  would 
help  to  establish  both  a  valid  Job  evaluation  and  sxibsequent 
wage  progreun. 


TABLE  14 

EXTENT  OF  HOSPITAL  USAGE  OP  JOB  DESCRIPTIONS  RATHER 
THAN  JOB  TITLES  IN  SECURING  WAGE  INFORMATION 
(COMBINED  SURVEY  RESULTS) 


Frequency  of  Responses 

Item 

Number 

Per  Cent 

Use  job  descriptions  only 
Do  not  use  job  descriptions 
Use  both  descriptions  amd 

job  titles 
No  answer 

156 
105 

11 
31 

51 
35 

4 

10 

Total 

303 

100 

source:  Hospital  Job  Evaluation  Survey. 


"'•Several  institutions  not  only  used  descriptions 
in  seeking  wage  information  but  also  included  a  job 
summary,  examples  of  work  performed,  requirements  and 
qualifications  of  the  job  and  the  occupational  code 
number  for  each  job. 
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Although  most  hospitals  surveyed  used  more  than  one 
method  of  securing  wage  information,  about  41  per  cent  of 
those  reporting  use  of  wage  surveys  indicated  that  such 
surveys  were  undertaken  through  the  mail  (see  Table  15) . 
Such  a  method  lends  itself  admirably  to  group  surveys  and 
may  be  much  more  definitive  in  giving  information  on  which 
to  determine  comparative  job  content. 

TABLE  15 

MEANS  USED  BY  HOSPITALS  IN  UNDERTAKING  WAGE  SURVEYS 
(MAILED  SURVEY  RESULTS  ONLY) 


Frequency  of  Responses 

Method  Used 

Number 

Per  Cent 

Mail 

Phone 

Interview 

Hospital  Council 

Other 

132 
56 
87 
30 
20 

41 

17 

27 

9 

6 

Total 

325* 

100 

Source:   Hospital  Job  Evaluation  Survey, 

*Exc<-eds  total  nxairiber  of  hospitals  as  several  hos- 
pitals checked  more  than  one  method* 


As  to  types  of  jobs  on  vAiich  wage  information  was 
sought,  two- thirds  of  the  hospitals  reported  that  such 
information  was  sought  on  any  job  vAiich  needed  pricing  (see 
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Table  16).   In  terms  of  establishing  internally  consistent 


■mBLE  16 

TYPES  OF  JOBS  ON  WHICH  HOSPITALS  SEEK  WAGE 
INFORMATION  (MAILED  SURVEY  RESULTS  ONLY) 


Frequency  of  Responses 

Type  of  Job 

Number 

Per  Cent 

Any  type  job 

Key  or  Bench-Mark  jobs  only 

No  answer 

158 
59 
26 

65 
24 
11 

Total 

243 

100 

Source:  Hospital  Job  Evaluation  Survey. 


wage  rates  this  procedure  constitutes  a  breach  of 
acceptable  procedure.   Such  a  process  is  tantamount  to 
pricing  unique  jobs  on  the  basis  of  inadequate  and  oft~ 
times  spurious  information.   This,  of  course,  represents 
the  distinction  between  pricing  jobs  on  an  adequately  val- 
idated formal  job  evaluation  procedure  and  attempting  to 
price  them  on  "raw"  wage  data.  This  distinction  is  of  par- 
ticular importance  in  attempting  to  set  a  wage  on  so-called 
unique  or  non-key  jobs.   Inasmuch  as  basic  key  job  wage 
information  is  all  that  is  needed  in  operating  the  point 
plan,  it  is  interesting  to  note  that  19  (50  per  cent)  of  the 
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hospitals  reporting  use  of  a  point  plan  still  seek  wage 
rates  on  any  and  all  jobs.   In  some  Instcmces,  jobs  are  so 
unique  to  the  individual  orgemization  that  no  vrage  infor- 
mation is  available  at  all.   In  other  cases,  such  a  limited 
number  of  like  jobs  exist  in  the  labor  market  that  wage 
information  secured  on  them  could  hsurdly  be  ej^ected  to 
adequately  portray  the  going  rate.  Use  of  such  inadequate 
wage  data  in  pricing  jobs  leads  to  internal  inconsistencies 
in  the  wage  program.  Whether  these  institutions  are  merely 
using  the  information  secured  to  check  on  the  plan's  pricing 
of  unique  jobs  or  vtoether  they  are  prostituting  the  plan  by 
using  such  information  regardless  of  what  the  plan  indicates 
as  tlE  proper  rate  is  subject  to  conjecture. 

From  data  received  relative  to  the  question  "what 
sources  do  you  contact  in  seeking  wage  information,"  it  is 
apparent  that  the  local  hospital  council  emd  local  businesses 
dominate  the  scene  (see  Table  17).   Perhaps  this  is  as  to  be 
expected  since  the  hospital  is  competing  with  community 
businesses  for  as  many  as  three- fourths  of  all  its  jobs. 
For  jobs  o£  a  medical  nature  the  local  council,  since  it  is 
in  constant  contact  with  the  msmy  member  institutions. 


^As  an  example:  One  hospital  analyzed  had  estab- 
lished 197  different  jobs.  Of  this  number  134  or  approx- 
imately 70  per  cent  were  in  competition  with  business 
concerns. 
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might  easily  serve  as  a  clearing  house  for  vraige  information. 
In  a  few  instances  ^f^ere  local  councils  are  handling  an 
integrated  and  formal  wage  survey.  Job  titles  have  been 
standardized  thus  rendering  the  task  of  securing  interhos- 
pital  rates  much  less  time  cons\iming  and  saving  the  risk  of 
substantial  variation  in  job  content, 

TABLE  17 

SOURCES  CONTACTED  BY  HOSPITALS  IN  SEEKING  WAGE 
INFORMATION  (MAILED  SURVEY  RESULTS  ONLY) 


Sources  of  Information        Frequency  of  Responses 


Local  Hospital  Council  151 

Local  Businesses  127 

Business  Wage  Surveys  86 

Government  Wage  Surveys  83 

State  Hospital  Association  75 

Nurses  Association  65 

Professional  Associations  63 

American  Hospital  Association  58 

Other  Area  Hospitals  42 

Local  Unions  18 

Hospital  Personnel  Management  Association  6 

Cheuiiber  of  Commerce  5 

State  and  County  Surveys  5 

Others  14 


Total  798^ 


Source t  Hospital  Job  Evaluation  Survey. 

^Exceeds  total  number  of  hospitals  as  many  hos- 
pitals checked  more  than  one  method. 
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Use  of  a  coininittee  In  developing,  installing  and 
operating  the  hospital  job  evaluation  program.  One  of  the 
major  variations  in  hospital  methodology,  when  compared  to 
industrial  experience,  is  the  relative  lack  of  use  of  a 
job  evaluation  committee,  of  the  143  hospitals  indicating 
that  they  had  either  established  an  evaluation  plan  or  were 
in  the  process  of  doing  so,  only  45,  or  less  than  one-third, 
reported  making  use  of  a  committee  for  aid  in  the  develop<- 
ment  or  operation  of  the  plan.   In  a  comparative  industrial 
stuc^,  64  per  cent  of  the  larger  companies  and  63  per  cent 
of  smaller  companies  (less  than  1,000  employees)  indicated 
the  use  of  a  job  evaluation  ccsranittee  in  establishing  the 
plan  in  use.^  Clearly  the  importance  of  group  participation 
has  not  permeated  the  hospital  —  at  least  with  regard  to 
preliminary  phases  of  wage  gmd  salary  administration. 

Inasmuch  as  the  use  of  such  a  group  constitutes  an 
effective  means  of  securing  acceptance  of  the  program  by 
employees,  first  line  supervisors  and  department  heads,  its 
inclusion  in  the  program  should  be  a  matter  of  primary 
importance.   The  use  of  a  committee  tends  to  modify  extremes 
or  "halo"  rating,  especially  if  the  committee  functions  as 


Job  Evaluation,  The  Bureau  of  National  Affairs, 
Inc.,  Washington,  D.  C,  survey  No.  40  (December  1956), 
p.  6. 
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an  Integrated  group  in  discussing  variations  that  may  have 
occurred  in  rating  common  jobs.   Furthermore,  the  use  of 
a  group  tends  to  lend  continuity  to  the  rating  procedure. 
This  is  especially  important  in  subsequent  ratings  of  new 
jobs  or  in  a  rerating  of  old  jobs  that  may  have  changed. 
In  addition,  v^ere  unions  represent  hospital  employees, 
bringing  a  union  representative  into  the  job  evaluation 
committee  will  enhance  its  final  acceptance  among  the  union 

membership. 

In  an  effort  to  seek  the  composition  of  the  job 
evaluation  committee  where  used,  as  well  as  to  determine 
the  extent  of  usage  either  for  purposes  of  installing  or 
administering  the  established  plan,  a  question  concerning 
the  title  of  those  comprising  the  corranittee  was  posed. 
TThose  institutions  \^ich  have  made  use  of  an  evaluation 
committee  have  included  representatives  from  a  wide  range 
of  individuals  (see  Table  18).   However,  there  appears  to 
be  little  or  no  consistency  in  approach  to  selecting  depart- 
ment heads  and/or  supervisors  to  serve  on  the  committee. 
Apparently,  it  is  a  matter  of  administrative  preference  or 
the  importance  of  certain  functions  which  determines  who 
will  be  selected  to  serve. 

A  refreshing  approach  involving  a  democratic  pro- 
cess of  selection  was  fotond  in  two  different  hospitals. 
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TABLE  18 


TITLES  OF  HOSPITAL  PERSONNEL  COMPRISING  THE  JOB 
EVALUATION  COMMITTEE  (LISTED  IN  ORDER  OF 
FREQUENCY  OF  RESPONSE)  (COMBINED 
SURVEY  RESULTS) 


Frequency 

Frequency 

of 

of 

Response 

Response 

Personnel  Director 

35 

Budget  Director 

1 

Assistant  or  Associate 

Credit  Manager 

1 

Administrator,  Director 

Purchasing  Agent 

1 

or  Superintendent 

24 

Job  Analyst 

1 

Administrator  or  director 

17 

Position  Classifier 

1 

Department  Head  affected 

17 

Director  In-Service 

Director  or  Assistant  or 

Training  or  Tmg.  Dir. 

1 

Associate  Director  of 

Asst.  Medical  Director 

1 

Nursing 

13 

Chief  Lab,  Technician 

1 

Comptroller,  Treasvirer  or 

Chief  x-ray  Technician 

1 

Assistant  A 

11 

Medical  Technologist 

1 

Administrative  Assistemt 

Director  Clinical  Labs 

1 

or  Resident 

6 

Maintenance  Director 

1 

Consultant 

8 

Warehouse  Supervisor 

1 

Dietician 

7 

Director  Plant  Services 

1 

Supervisor  affected 

6 

Health  Educator 

1 

Chief  Engineer 

3 

Supervisor,  Personnel 

Nursing  Service  Repre- 

Education 

1 

sentative 

3 

Food  Manager 

1 

Business  Office  Manager 

3 

Group  of  6  Dept.  Heads 

1 

Key  Employees 

3 

Assistant  Dean,  College 

Medical  Records  Librarian 

of  Business 

1 

or  Asst. 

2 

ChM   Accountant  Salary 

Director  of  Patient 

Admin. 

1 

Services 

2 

No  Committee  used  or 

Executive  or  Assoc. 

no  answer 

98 

Housekeeper 

2 

Pharmacist 

2 

Director,  School  of 

Nursing 

2 

Member,  Board  of  Trustees 

2 

Employment  Manager 

2 
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TABLE  18 — Continued 


Frequency 
of 
Response 

Frequency 
of 
Response 

Asst.  Personnel  Director 

or  Personnel  Assistant    2 
Purchasing  Agent           2 

Total 

292* 

Sources  Hospital  Job  Evaluation  Survey. 

"Exceeds  number  of  plans  in  effect  plus  those  in 
process  of  being  installed  because  many  hospitals  checked 
more  than  one  answer. 


One  of  the  Job  Evalviation  manuals,  in  describing  the  process 
of  committee  selection,  states  that  "a  list  of  the  names 
of  the  supervisors  grouped  in  related  activities  was  sub- 
mitted to  all  department  heads.  Each  department  head  indi- 
cated on  the  list  each  person  he  would  nominate  to  repre- 
sent the  various  functionally  related  departments  of  the 
hospital.   The  names  of  the  persons  receiving  the  highest 
number  of  nominations  were  given  to  the  administrator  who 
then  appointed  these  selected  persons  to  act  as  a  Job  Eval- 
uation committee."^  Here  is  an  excellent  example  of 


^Job  Evaluation  Manual,  Salt  Lake  county  General 
Hospital,  Salt  Lake  City,  Utah. 
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consultative  management,  a  primary  means  of  stressing 

genuine  respect  for  the  personality  and  dignity  of  the 

1 
individual.    In  turn  such  action  hastens  acceptance  of 

administrative  leadership  and  programs. 

In  analyzing  the  composition  of  the  Job  Evaluation 
Committee  as  used  in  the  hospital,  perhaps  the  most 
important  revelation  is  the  apparent  concentration  of 
committee  membership  in  the  administrative  end  of  the  or- 
ganizational spectrum.  Tliis  is  somei^at  disconcerting  in 
view  of  the  proven  necessity  of  seeking  the  active  cooper- 
ation of  all  elements  of  the  organization.  Admittedly, 
all  of  the  representatives  mentioned  could  not  effectively 
serve  on  a  single  committee;  however,  it  would  seem  feasible 
to  consistently  include  at  least  representatives  of  the 
major  divisions  or  groups  within  the  hospital  (i.e.,  office, 
trades,  dietary,  etc.)  as  members  of  the  evaluation  com- 
mittee. One  interesting  point x   three  hospitals  reported 
that  selected  key  employees  were  asked  to  serve  on  the  com- 
mittee. This  procedure,  although  somewhat  unusual,  might 
well  seirve  to  impress  the  rank-and-file  with  the  idea  that 
their  interests  cire  being  protected  by  their  associates. 


George  V.  Moser,  "Consultative  Management, " 
Management  Record,  XXIII,  No.  9  (October,  1955) ,  p.  438. 
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Table  19  indicates  that  the  distribution  of  meihbers 
serving  on  such  committees  ranged  from  two  to  eight.   Ex- 
cluding those  responses  vAiich  reported  no  committee,  those 
in  vAiich  there  was  no  answer,  amd  those  in  vAiich  an  answer 
could  not  be  ascertained,  approximately  one-half  of  the 
respondents  reported  that  three  or  four  members  constituted 
the  committee  membership.  Nevertheless,  there  was  little 
discernible  difference  between  the  use  of  three,  four,  five 
or  six  committee  members, 

TABLE  19 

DISTRIBUTICMJ  OF  NUMBER  OF  MEMBERS  SERVING  ON  THE 
HOSPITAL  JOB  EYALUATICMI  COMMITTEE 
(COMBINED  SURVEY  RESULTS) 

Item  Number  Serving 

Two  1 

Three  10 

Four  10 

Five  7 

Six  9 

Seven  3 

Eight  1 

Unable  to  determine  6 

No  Committee  96 


Total  143 


Source:  Hospital  Job  Evaluation  Survey, 
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One  of  the  most  Important  considerations  in  deter- 
mining the  niunber  of  committee  members  to  use  is  the  degree 
of  participation  desired.   The  more  participation  that  is 
to  be  allowed,  the  larger  the  ccwranittee  will  be.  However, 
the  size  of  the  committee  must  of  necessity  be  limited  to 
a  workable  number.   This  will  vary  from  hospital  to  hospital 
depending  upon  the  size  of  the  institution  as  well  as  the 
philosophy  of  the  top  administrators  toward  involving 
operating  personnel  in  the  program.   In  several  instances 
those  in  charge  of  development  of  the  hospital  Job  eval- 
uation program  stated  that  use  of  a  ccaranittee  had  proven 
ineffective.   Indication  was  that  the  coranittee  had  become 
bogged  down  in  indecision.   Further  questioning  of  the 
individuals  involved  revealed  that  inadequate  planning 
and  lack  of  orientation  of  committee  members  were  largely 
responsible  for  the  failure.   In  addition,  the  immediate 
supemrisor  of  the  department  in  which  jobs  were  being  rated 
%ias  frequently  left  out  as  an  ex-officio  member  of  the 
rating  committee.  Such  actions  invariably  lead  to  unsatis- 
factory results. 

Responsibility  for  development  eind  operation  of  the 
lob  evaluation  plan.  Based  upon  frequency  of  response,  the 
chief  responsibility  for  development  and  installation  of  the 
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Job  evaluation  program  rests  primarily  with  the  adminis- 
trator or  his  assistant  and/or  the  hospital's  personnel 
department.   In  the  day-to-day  operation  of  the  plan,  the 
administrator  plays  a  much  lesser  role.   This  is  as  it 
should  be.   The  administrator  is  concerned  with  a  multi- 
tude of  important  issues  and,  consequently,  cannot  concern 
himself  with  operational  details  of  the  Job  evaluation 
plan.   In  those  instances  y/ttere   the  administrator  was  in- 
volved in  trying  to  operate  the  plan,  the  v^ole  program 
suffered.   Insufficient  time  was  available  to  adequately 
maintain  the  operation  on  a  sound  basis. 

It  is  interesting  to  note  that  each  of  the  38  hos- 
pitals reporting  use  of  a  formal  point  system  of  Job  eval- 
uation indicated  that  the  personnel  department  was  involved 
in  both  the  development  and  day-to-day  fvmctioning  of  the 
plan.   Furthermore,  combined  survey  results  suggest  that 
for  the  actual  administration  of  the  evaluation  plan,  the 
hospital  generally  turns  to  those  charged  with  the  personnel 
activity;  however,  the  administrator  or  his  assistant  still 
operates  the  program  in  a  considerable  number  of  instances. 
In  a  study  of  industrial  concerns,  70  per  cent  of  large  firms 
and  75  per  cent  of  small  firms  (less  than  1,000  employees) 
turn  the  responsibility  for  the  operation  of  the  plan  over 
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to  the  personnel-industrial  relations  department.   Of 
total  responses  from  hospitals  with  a  formal  job  evaluation 
plzm  in  effect,  the  personnel  department  is  mentioned  much 
more  frequently  thcui  amy  other  fxinctional  group  as  having 
charge  of  day-to-day  operation  of  the  plan.  As  a  matter  of 
fact,  the  frequency  of  total  responses  corresponds  favorably 
with  the  70-75  per  cent  incidence  in  industrial  concerns 
in  v^ich  personnel  has  been  given  responsibility  for  the 
Job  rating  progreun. 

In  the  area  of  program  development  and  installation, 
a  rather  restricted  use  is  made  of  outside  consultants. 
Ccxnbined  survey  results  indicate  the  use  of  consultants  by 
the  hospital  in  only  52  instances  (see  Table  20).  This  re- 
presents less  than  20  per  cent  of  all  responses.  The  hos- 
pital again  falls  short  of  the  record  of  industrial  concerns 
\^ere  45  per  cent  of  large  firms  and  55  per  cent  of  small 
firms  (less  than  1,000  employees)  made  use  of  outside  con- 
sultants.^ This  reluctemce  on  the  part  of  the  hospital  to 
use  consultants  is  not  necessarily  bad.   Survey  results 
suggest  that  in  only  a  limited  niimber  of  instances  have 


•*-Job  Evaluation,  The  Bureau  of  National  Affairs, 
Inc.,  op.  cit. ,  p.  7. 

2ibid. 
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consultants  undertaken  to  validate  the  hospital  evaluation 
plan.  Without  an  understanding  of  the  rationale  of  validity, 
the  consultant  is  no  better  qualified  than  the  hospital 
personnel  department  to  install  a  "correct"  evaluation  plan. 


•mBI£  20 

INDIVIDUAL  OR  GROUP  RESPONSIBLE  FOR  DEVELOPING, 
INSTALLING  AND  DAY-TO-DAY  OPERATION  OF  THE 
HOSPITAL  JOB  EVALUATION  PLAN  (COMBINED 
SURVEY  RESULTS) 


Responsible  Group  or 
Individual 

• — ■ 1 

Developing  and 
Installing 

Day-to-day 
Operation 

Administrator  and/or  assistant 
Personnel  Department 
Job  Evaluation  Committee 

85 
84 
33 

25 
71 
14 

Outside  Consultant 

52 

3 

Department  Heads 
Central  Civil  Service 

1 

1 

Commission 

7 

6 

Hospital  Liaison 
Classification  Department 

0 

1 

7 
0 

Totals 

263* 

127^ 

source J  Hospital  Job  Evaluation  Survey. 

^Exceeds  number  of  plans  in  effect  plus  those  in 
process  of  being  installed  as  many  hospitals  checked  more 
than  one  amswer. 

l^xceeds  number  of  plans  in  effect  as  some  hospitals 
checked  more  than  one  answer. 
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Breaking  dovm  the  survey  results  according  to  the 
type  of  plan  in  effect  in  the  hospital,  47  per  cent  reporting 
use  of  a  classification  plan  indicated  use  of  a  consultant 
in  developing  the  program.  On  the  other  hand,  58  per  cent 
of  those  reporting  use  of  a  point  plan  made  use  of  a  con- 
sultant. Seventeen  per  cent  of  the  hospitals  with  a  ranking 
plan   used  a  consultant  vihile  the  two  factor  comparison 
plans  both  reported  non-usage  of  outside  agencies.   In 
connection  with  the  fxinctions  performed  by  the  consultant, 
only  three  hospitals  out  of  the  entire  sample  indicated  use 
of  a  consultamt  in  day-to-day  operation  of  the  program.   To 
all  intents  2uid  purposes,  \i^ere  outside  help  is  secured, 
seirvices  are  confined  to  developing  the  program  and  training 
hospital  personnel  to  assiime  the  responsibility  for  operating 
the  plam.  The  trend  followed  here  is  the  ssune  as  that  v^iich 
is  generally  found  in  business  and   industry. 

With  respect  to  hospital  use  of  the  consultamt,  a 
word  of  caution  is  in  order.  Experience  indicates  that  a 
management  consulting  firm  with  specific  experience  in  the 
hospital  field  would  prove  most  satisfactory.   In  several 
instances,  criticism  was  leveled  at  industrial  consultants 
by  hospital  administrators  who  complained  that  those  brought 
in  to  establish  the  program  were  not  familiar  with  the 
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unique  relationships  within  the  hospital.   Consequently, 
they  failed  to  grasp  the  importance  of  talcing  these 
factors  into  consideration  in  creating  a  plan  acceptable 
to  all  concerned. 

There  is  still  a  general  lack  of  understanding  and 
acceptance  on  the  part  of  these  consulting  agencies  of  the 
importance  of  validating  the  job  evaluation  plan.   Only 
one  of  the  above  mentioned  groups  actually  validated  the 
plans  it  helped  to  install  in  several  hospitals.   This  re- 
presents a  serious  omission  on  the  part  of  the  consultants 
since  a  non-validated  plan  cannot  be  proven  to  adeqtiately 
represent  a  consistent  internal  wage  program  for  the  hos- 
pital. Without  validity,  the  evalxiation  program  is  nothing 
short  of  unmitigated  guess-work.   This  is  harsh  criticism 
to  level  against  those  vflio  stemd  in  the  position  of  advising 
on  top  management's  actions;  however,  in  this  instance  such 
charges  are  justified.   It  is  evident  that  job  evaluation 
validity  studies  must  be  more  actively  prcxnulgated. 

Since  the  job  rating  procedure  constitutes  one  of 
the  more  important  functions  in  implementing  job  evaluation, 
questions  regarding  this  phase  of  the  program  were  scrut- 
inized in  detail.   In  surveying  results,  the  item  of  fore- 
most impor1;ance  is  that  the  immediate  superior  is  left  out 
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of  the  rating  process  more  frequently  than  he  is  included 
(see  Table  21).  Generally  \^en  such  a  glaring  omission  is 

T?VBI£  21 

HOSPITALS  INDICATING  AUTOMATIC  INCLUSION  OP  THE 
IMMEDIATE  SUPERIOR  IN  THE  RATING  GROUP 
(COMBINED  SURVEY  RESULTS) 


Frequency  of  Response 

Item 

Number 

Per  Cent 

Include  Immediate  Superior 
Do  not  include  immediate 

Superior 
No  answer 

57 

60 
26 

40 

42 

18 

Total 

143 

100 

Source:  Hospital  Job  Evaluation  Siirvey. 


made,  expediency  is  the  answer.   It  is  difficult  to  envision 
the  acceptance  of  a  plan  in  v^ich  such  a  vital  link  has 
been  omitted.   S.  Avery  Raube,  National  Industrial  Confer- 
ence Board,  director,  reporting  on  the  findings  of  a  Con- 
ference Board  study  into  the  operation  of  employee  salary 
plans,  indicated  that  lack  of  effective  coranunication  was 
one  of  the  major  criticisms  expressed  by  participating 
en^lc^ees  smd  supervisors  alike.  As  Raxobe  explained  it 
"they  Lthe  supervisors]  didn't  understand  the  plain  they 
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were  helping  to  administer. • .frnpervlsors  In  many  cases  have 
little  opportunity  to  participate  in  the  formative  stages 
of  such  a  plan."    In  commenting  further  on  the  lack  of 
enthusiasm  or  acceptance  of  systematic  plans  of  salary 
administration  Raxibe  concluded  that  "luider standing  and 
acceptance  seem  to  go  hand-in-hcmd. '    It  is  an  accepted 
fact  that  understanding  comes  with  participation.   Fur- 
thermore«  no  one  understands  the  Jobs  within  his  Juris- 
diction better  than  the  supervisor.   He  is  acutely  aware 
of  the  requirements  of  each  job  and  the  extent  to  vdiich 
each  of  the  rating  factors  is  present  in  the  Jobs. 
Failure  to  make  use  of  the  immediate  supervisor  in  the 
rating  process  creates  a  distinct  bsurrier  to  the  effective 
use  of  Job  evaluation  in  the  hospital. 

Perhaps  the  size  of  the  rating  group  is  an  effective 
deterrent  to  the  inclusion  of  the  immediate  supervisor  in 
all  rating  procedures.   Omitting  those  responses  v^ich 
gave  no  answer  and  those  in  v^ich  it  was  impossible  to 
determine  the  number  serving  vrith  the  rating  group,  it  will 
be  seen  that  67  per  cent  of  the  hospitals  reported  that  only 
one  or  two  persons  were  used  to  rate  Jobs  (see  Table  22) . 


^S.  Avery  Raube,  "Employees  Look  at  Salary  Admin- 
istration," Personnel  Journal,  XXVIII,  No.  5  (October  1949), 
p.  167.   (Insert  added.) 

2  Ibid. 
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TABLE  22 


DISTRIBUTION  OF  NUMBER  OF  PERSONS  SERVING  IN  THE 
HOSPITAL  RATING  GROUP  (COMBINED 
SURVEY  RESULTS) 


Item 

Frequency  of 
Response 

One 

29 

Two 

Three 

Four 

Five 

Six 

40 

12 

10 

4 

3 

Seven 
Eight 
Nine 
Unable 

to 

determine 

3 
0 

1 
16 

No  answer 
Total 

25 

143 

Sources  Hospital  Job  Evaluation  Survey, 

When  the  number  serving  on  the  rating  group  is  increased 
to  include  three  or  four  persons,  90  per  cent  of  respondent 
hospitals  are  included.  One  hospital  reported  nine  per- 
sons serving  on  the  rating  group;  however,  this  appeared 
to  be  highly  unusual.  Of  the  102  responses  used  (25  out  of 
143  did  not  cmswer  the  question  and  in  16  cases  it  could 
not  be  deterxnined  who  rated  the  Jobs) ,  over  half  (66)  re- 
ported that  the  personnel  director  or  his  assistant  was 
included  in  the  rating  group.  On  the  other  hand,  the 
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administrator,  assistant  administrator  or  an  administra- 
tive assistant  v«re  included  in  the  rating  group  equally 
as  often  as  the  personnel  department  representative.   There 
appears  to  be  a  conflict  between  the  number  of  respondents 
stating  that  the  immediate  superior  was  automatically  in- 
cluded in  the  rating  group  (57  so  asserted  -  see  Table  20) 
and  the  number  indicating  that  the  department  head  or 
supervisor  affected  was  included  in  the  rating  group  (41 
responses  -  see  Table  22) .   This  conflict  is  more  apparent 
than  real,  however,  for  some  respondents  listed  the  specific 
titles  of  immediate  supervisors  who  rated  jobs  rather  than 
merely  stating  that  the  supervisor  affected  was  included  in 

the  rating  group. 

A  glance  at  Table  23  will  confirm  the  fact  that  the 
administrative  group  in  the  hospital  tended  to  dominate  the 

TABI2  23 

TITLE  OF  PERSON (S)  ACTUALLY  RATING  JOBS  IN 

THE  HOSPITAL  (LISTED  IN  ORDER  OF  FREQUENCY 

OF  RESPONSE)  (COMBINED  SURVEY  RESULTS) 


Frequency 

Person  o^ 

Rating  Response 


Personnel  Director       60 
Department  Head  of 

Supervisor  affected    41 


Frequency 

Person  of 

Rating  Response 


Director,  School  of 

Nursing  1 

Director,  Clinical  Lab   1 
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TABUS  23~Continued 


Frequency 

Frequency 

Person              of 

Person 

of 

Rating             Response 

Rating            Response 

Asst. ,  Assoc.  Adminis- 

Medical Technician 

trator,  Director  or 

Chief  Pharmacist 

Superintendent 

33 

Director,  Patient 

Administrator,  Director 

Services 

or  Supt. 

23 

Food  Mamager 

Consul  taunt 

25 

Budget  Director 

Comptroller  or  Assistant 

12 

Accountant 

Director  or  Asst.  or 

Purchasing  Agent 

Associate  Director  of 

Asst.  Employment  Mgr, 

Nursing 

0 

Poiition  Classifier 

Administrative  Assistant, 

Sr.  Personnel  Inter- 

Intern or  Resident 

8 

viewer 

Personnel  Assistant 

6 

Classification 

Job  Analyst 

4 

Director 

Business  Mamager 

3 

Supervisors  in  groups 

Dietician 

3 

of  fifteen 

Civil  Service  Commission 

3 

Maintenzince  Director 

Nursing  Service 

Warehouse  Supervisor 

Repre  sentat i ve 

2 

Director,  Plant 

Director,  In-Sesrvice 

Services 

Training 

2 

Service  Assistant 

Medical  Records  Librarian     | 

County  Board  Super- 

or Assistant 

2 

visors 

Exec.  Housekeeper  or 

State  Personnel  Super- 

■ 

Assistamt 

2 

visor 

Chief  Engineer 

2 

County  Personnel 

Public  Administration 

Director 

1 

Service 

2 

Representative  of  Boaurd 

Personnel  Technicians 

2 

of  Trustees 

1 

Purchasing  Agent 

2 

Salary  Administrator 

1 

No  ansvier 

25 

Total 

293* 

source:  Hospital  Job  Evaluation  Survey, 

^Exceeds  number  of  plans  in  effect  plus  those  in  pro- 
cess of  being  installed  as  many  hospitals  checked  more  than 
One  answer. 
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rating  procedure.   However,  a  rather  sizeable  number  of 
respondents  indicated  that  the  department  head  or  super- 
visor affected  served  on  the  rating  conunittee.  Again,  it 
is  quite  possible  that  many  other  supervisory  personnel 
specifically  named  as  serving  on  a  rating  ccmimittee  could 
also  be  included  in  this  category.   The  supervisor  should 
always  be  included  in  the  rating  group  as  an  ex-officio 
member.   This  not  only  gains  support  for  the  program  but 
also  includes  in  the  rating  group  an  individual  v^o  best 
understands  all  facets  of  the  jobs  \inder  his  Jurisdiction. 
In  at  least  two  of  the  most  effective  Job  evaluation  plans 
studied,  department  heads  were  requested  to  submit  the 
neunes  of  persons  they  would  nominate  to  represent  the 
various  functionally  related  departments  of  the  hospital. 
The  administrator  then  selected  the  names  appearing  most 
frequently  to  serve  as  a  c<Mnmittee.   Such  a  procedure  gave 
department  heads  an  opportvmity  to  participate,  and  there- 
fore, tended  to  gain  their  support  for  the  program. 

Securing  acceptance  of  the  hospital  job  evaluation 
plan.  A  cursory  glance  at  the  methods  used  by  hospital 
administrators  smd  personnel  managers  to  gain  acceptance 
of  the  Job  evaluation  prograun  shows  them  to  be  many  and 
varied.   It  is  immediately  evident  that  a  good  deal  more 
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ern|>hasls  is  placed  upon  the  need  for  securing  acceptzmce 
of  the  program  on  the  supervisory  level  (department  heads 
and  supervisors)  than  on  the  rank-and-file  level  —  this 
despite  the  fact  that  this  area  ccmstitutes  the  major 
source  of  grievances  and  discontentment  vfliich  tend  to 
lead  to  collective  agreements.   It  would  seem  that  admin- 
istrators and  personnel  managers  in  the  hospital  are  over- 
looking this  obvious  and  all  important  fact.   Supervisors 
may  be  sold  on  the  virtues  of  the  plan  but  if  the  employees 
are  not,  trouble  is  almost  certain  to  appear.  Hospitals 
indicated  352  instances  in  \tfhich  some  means  v^as  used  to 
secure  acceptance  "by   the  department  head.   For  employees 
the  corresponding  frequency  was  only  205  instances  (see 
Taible  24) .   The  numbers  themselves  are  unimportant,  the 
relative  difference  is  Indicative.   It  is  readily  apparent 
that  hospitals  have  given  a  great  deal  more  attention  to 
first-line  management  than  to  operative  en^loyees  in  seeking 
to  gain  progreun  acceptance.   Substemtially  the  same  con- 
dition exists  in  industry  according  to  a  survey  conducted 
by  the  Bureau  of  National  Affairs.   The  results  of  this 
study  suggest  that,  "in  general  companies  go  to  much  greater 
lengths  to  explain  the  mechanics,  policies,  and  methods  of 
job  evalxaation  to  management  personnel  than  to  rank-and-file 
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employees. . .rank-and-file  employees  are  fully  briefed  on 

the  mechanics  of  evalvation  in  only  about  one- fourth  of 
con5)anies.*'-'- 

TkBI£   24 

METHODS  USED  BY  HOSPITALS  IN  SECURING  ACCEPTANCE 

OF  THE  JOB  EVALUATION  PLAN  (MAILED 

SURVEY  RESULTS  ONLY) 


Department 

Method  Used 

Heads 

Supervisors 

Employees 

Participation 

79 

60 

44 

Letter  from  Admin- 

istrator 

52 

29 

25 

Staff  meetings 

66 

34 

16 

Departmental  group 

meetings 

43 

36 

34 

Individual  conferences 

57 

38 

29 

Descriptive  literature 

24 

17 

17 

Employee  publications 

21 

20 

30 

Union  representatives 

3 

2 

3 

Conferences  with  em- 

ployee leaders 

4 

4 

5 

Films  shovm 

1 

X 

0 

Job  analysis  com- 

mittee meeting 

1 

0 

0 

Authorization  by  Exec- 

utive Officers 

1 

1 

1 

Totals 

352* 

242 

205 

Source;  Hospital  Job  Evaluation  Survey. 

^Exceeds  total  nvunber  of  plans  as  mamy  hospitals 
checked  more  than  one  method. 


^Job  Evaluation,  The  Bureau  of  National  Affairs. 
Inc.,  op.  cit.,  p. 13. 
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Of  the  four  most  Importamt  mesuis  used  by  the  hos- 
pitals to  secure  acceptance  of  the  program  as  evidenced  by 
the  nuniber  of  responses,  two  methods  appear  to  be  considered 
most  Important  for  all  three  levels  of  operation:   (1)  par- 
ticipation and  (2)  individual  conferences.  One  of  the 
chief  means  of  securing  employee  acceptance  through  partici- 
pation —  employee  job  description  questionnaires  —  is 
being  utilized  rather  frequently  by  hospitals.   In  the 
opinion  of  one  administrator t  "We  feel  that  usually  no 
one  is  in  a  better  position  to  describe  a  Job  than  the 
person  doing  the  work."   In  response  to  the  question  "vAiat 
methods  were  used  to  secure  information  for  the  job 
descriptions, "  almost  50  per  cent  of  those  hospitals  using 
a  formal  plan  or  in  the  process  of  installing  one  reported 
that  employees  were  given  the  opportunity  to  fill  in  a  job 
description  questionnaire  or  be  inteicviewed  plus  filling 
in  a  questionnaire.   It  is  generally  agreed  that,  "xi^en 
salary  standards  are  established  through  job  evaluation  they 
affect  the  lives  of  all  employees, . . .Anything  so  far-reaching 
should  be  handled  in  a  way  that  is  acceptable  to  everyone 
affected.   Better  results  are  obtained  therefore  v^en 


^Job  Evaluation  Manual,  St.  Luke's  Hospital, 
Bethlehem,  Pennsylvania. 
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evaluation  procedures  are  participated  in  by  as  many 
employees. . .as  possible.  Employees  can  participate  by 
furnishing  information  about  their  Jobs  and  by  being 
asked  to  approve  resulting  Job  descriptions  \iAiich  have 
been  prepared."   The  implication  seems  clear  that  the 
more  methods  the  individual  hospital  can  develop  %Aiich 
will  encourage  employee  participation,  the  more  certain 
vrlll  be  employee  acceptance  of  the  final  results. 

As  might  be  expected,  staff  meetings  ranked  second 
in  importance  for  department  heads.  Even  for  supervisors 
such  a  mejuis  of  securing  acceptance  remked  in  the  top  four. 
Individual  conferences  were  important  for  all  three  groups 
although  for  employees,  the  use  of  departmental  group 
meetings  was  more  frequently  used.  This  is  as  might  be 
expected  since  the  rank-and-file  employees  make  up  a  sizeable 
segment  of  the  total  hospital  group  amd,  consequently,  a 
proportionately  greater  amount  of  time  would  be  consvuned 
v&re   individual  conferences  used.  Despite  this  fact, 
enough  hospitals  reported  use  of  individual  employee  con- 
ferences to  rate  it  as  one  of  the  top  four  methods  used. 
Whether  individual  conferences  or  group  meetings  are 


^"Job  Evaluation  As  a  Democratic  Process,"  Personnel 
Journal,  XXVII,  No.  2  (June,  1948),  p.  71. 
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employed,  enployees  should  be  assured  that  no  cut  in  wages 
will  be  made  as  a  result  of  the  institution  of  an  eval- 
uation plan.   Such  knowledge  will  definitely  assist  in 
gaining  employee  acceptauice  of  the  plan.   In  the  use  of 
written  naterial  as  a  sales  device,  letters  from  the  admin- 
istrator to  department  heads  served  as  an  important  meems 
of  trying  to  secure  cooperation  vfliile  the  employee  pvxbli- 
cations  were  rated  an  important  source  for  seeking  employee 
acceptance  of  the  program.  Other  selling  techniques  were 
used;  however,  they  were  of  relatively  less  importance  as 
actual  means  of  persuasion.  Whatever  the  method  used, 
selling  the  program  to  all  levels  of  management  and  em- 
ployees is  mandatory  if  the  program  is  to  be  successful. 

Factors  and  degrees  used  in  rating  hospital  jobs. 
One  of  the  more  iraportemt  questions  to  be  answered  in  devel- 
oping the  rating  plan  relates  to  the  number  and  type  of 
factors  to  use.   In  conjunction  with  this  question,  a 
decision  must  also  be  made  on  the  proper  weighting  of 
factors.  Questions  concerning  these  points  were  asked  on 
both  the  original  mailed  survey  sheet  as  well  as  a  supple- 
mentary letter  sent  to  all  hospitals  using  a  point  plan  of 
evalviation.  Answers  received  were  quite  revealing. 
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Factors  used  In  rating  jobs  In  the  hospital  were 
fairly  standard.  As  a  matter  of  fact,  many   of  the  hos- 
pitals appeared  to  have  picked  up  an  Industrial  plan  or 
at  least  a  plan  already  In  existence,  factors,  degrees, 
points  and  all,  and  applied  It  to  the  hospital.  A  rela- 
tively few  of  the  Institutions  contacted  had  attempted  to 
build  the  plan  to  suit  Individual  needs.   Since  Jobs  In 
the  hospital  are  much  the  same  from  one  Institution  to 
another.  It  Is  conceivable  that  factors  used  might  be  essen- 
tially the  same.   Of  the  hospitals  reporting  use  of  a  point 
plan  or  those  In  the  process  of  Installing  a  point  plan 
50  Included  a  listing  of  factors  used.  It  Is  apparent  from 
a  glance  at  Table  24  that  a  relatively  few  standard  factors 
are  used  in  a  majority  of  instances.   Since  the  hospital's 
major  objective  is  patient  care,  it  is  Interesting  to  note 
that  only  12  reporting  hospitals  indicated  the  use  of  a 
factor  that  would  seem  to  measure  the  value  of  this  job 
attribute.   Perhaps  the  factors  entitled  "effect  of  errors," 
"safety  of  others"  and  "interpersonal  relationships"  could 
be  used  to  cover  this  need.  A  reading  of  the  individual 
hospital's  factor  description  for  this  item  suggests  that 
this  is  the  case  in  some  instances  vAiile  in  others  no  such 
indication  appears.   Such  a  factor  should  always  be  included 
since  it  is  needed  to  measure  a  most  Important  aspect  of 
hospital  jobs. 
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TABLE  25 


FACTORS  USED  IN  RATING  HOSPITAL  JOBS  (BASED 
CttJ  A  TOTAL  OF  50  POINT  PIANS) 


Number 
of 
Responses 


Nvuhber 
of 
Responses 


Skill 

Education  38 

E35>erience  33 

Initiative,  Judgment, 
Complexity  of  vork  or 

Analytical  Requirements  27 

Experience  and  Training  12 

Mental  Resourcefulness 

or  Knowledge  9 

Manual  Dexterity  5 

Training  (General  or 

specialized)  5 

Education  and  Training  3 

Ability  to  make  Decisions  2 

Ability  to  do  detail  vfork  1 

Capacity  for  Self- 
expression  1 

Social  skill  1 

Effort 

Physical  Application, 

Demand  or  Effort       42 

Mental  Application, 

Demand  or  Effort       30 

Mental  and/or  visual  de- 
mand or  Application      5 

Emotional  Demand  2 

Pressure  of  Work  3 

Concentration  Required     2 


Responsibility  for 
Interpersonal  Relation- 
ships, Goodwill,  Per- 
sonal Contacts,  or 
Public  Relations 
Effect  of  errors.  De- 
pendability or 
Accuracy 
Supervision  and  Admin- 
istration of  others 
Confidential  Data 
Materials,  Products, 
Supplies  and/or 
Equipment 
Patient  Care  or  Safety 
Materials,  Products 

and  Money 
Safety  of  Others 
General  Responsibility 
Work  of  others 
Decisions  affecting  cost 
or  Expenditure  of  Or- 
ganization Funds 
Supervision  Received 
Effect  of  Negligence 
Carrying  out  Philos- 
ophy and  Objectives 
of  Hospital 
Working  Conditions 


30 


25 

23 
13 


12 

of  12 

9 

8 
6 
6 


5 
4 
2 


working  Environment  or 

Job  Conditions        45 

Accident  and  health  haz- 
ards or  job  hazards    18 

Working  Hours  1 

Variety  of  Work  1 


Source:   Hospital  Job  Evaluation  Survey. 
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Again,  there  was  little  variation  in  the  total 
nvuhber  of  factors  used  in  rating  jobs.  The  smallest  num- 
ber of  factors  (six)  approached  the  minimum  suggested  by 
Lawshe  in  his  work;  however,  this  number  of  factors  was 
used  in  only  one  hospital.  On  the  other  hand  no  radical 
departure  from  normalcy  in  terms  of  extent  or  amplitude  of 
factor  breakdown  was  discovered.  The  maximum  number  of 
factors  used  was  16  with  a  mediein  and  mode  of  ten  items. 

As  a  means  of  ascertaining  the  method  used  in  the 
selection  of  the  nvimber  and  type  of  factors  to  use  as  well 
as  the  means  of  deriving  the  relative  percentage  distri- 
bution or  weighting  among  factors,  a  supplementary  letter 
containing  questions  pertinent  to  this  point  was  sent  to 
each  of  the  38  hospitals  indicating  use  of  a  point  plan.   Re- 
sults received  from  the  20  participating  hospitals  were  quite 
revealing.  Eight  respondents  reported  the  use  of  a  committee 
in  the  selection  of  factors  deemed  important.   Two  hospitals 
indicated  the  acceptance  of  a  point  system  as  outlined  in  a 
book  on  hospital  persoimel  administration.   Six  additional 


^Twenty-three  responses  were  actually  received; 
however,  three  of  the  respondents  could  supply  little  in- 
formation on  the  plan  since  it  was  develox>ed  prior  to  their 
err^loyment. 
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institutions  reported  that  the  factors  had  been  supplied 
them  by  a  consultant  and  \*ere  used  without  modification 
%^ile  four  other  hospitals  stated  that  their  plan  vras  an 
adaptation  of  one  of  the  standard  industrial  plans.   In 
most  cases  those  v^o  had  selected  a  plan  from  industry  had 
at  least  modified  the  plan  to  include  factors  indigenous 
to  the  hospital;  however,  in  at  least  two  instemces  the 
plan  had  been  copied  verbatim. 

When  the  plams  were  studied  two  conditions  seemed 
to  stand  out.   In  the  first  place,  a  majority  of  hospitals 
included  in  the  stu^  made  little  attempt  to  "sell"  the 
idea  of  Job  evaluation  through  participation  in  factor 
selection.   In  eight  instances  a  committee  composed  of 
those  responsible  for  the  fimctioning  of  the  plam  was  given 
the  opportunity  to  iielect  factors  important  to  the  jobs  to 
be  rated.   Second,  an  analysis  of  the  plans  indicated  that 
in  some  cases  factors  had  been  picdced  up  from  a  previously 
existing  system.   This  approach  is  not  necessarily  bad  pro- 
vided am  analysis  of  the  sitviatlon  at  hand  suggests  the 
factors  in  question  as  necessary  in  measxiring  job  worth. 
However,  it  is  to  be  kept  firmly  fixed  in  mind  that  variatiora 
in  both  numbers  and  weightings  of  factors  may  result  in 
significant  differences  in  final  results.   The  general 
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impression  given  lay  several  respondents  who  were  using 
plans  copied  from  industry  or  even  other  service  organi- 
zations was  that  a  "custom  made"  program  would  be  more 
acceptable.  As  one  hospital  personnel  manager  wrote  con- 
cerning the  plan  in  use  at  his  institutioni   "I  feel  that 
there  is  much  to  be  desired  in  the  plan,  as  it  was  appar- 
ently designed  for  industry  rather  than  the  hospital. 
The  terminology  throughout  is  difficult  to  interpret  in 
terms  of  hospital  application.- 

In  answer  to  the  question  "how  were  the  relative 
weightings  apportioned  among  factors, "  there  seemed  to  be 
a  consistent  attempt  to  secure  the  opinion  of  the  group. 
Of  the  20  respondents,  all  but  six  reported  the  use  of  some 
type  of  committee  in  allocating  factor  weights.   Two  of  the 
hospitals  making  use  of  group  opinion  went  so  far  as  to 
poll  all  department  heads  as  well  as  roost  of  the  super- 
visors; another  hospital  even  included  all  levels  of  em- 
ployees in  the  poll.   In  the  latter  case  selected  employees 
from  all  eschelons  and  groups  were  given  the  opportunity  to 
rank  the  importance  of  the  factors  used.   The  results  served 
as  a  basis  for  the  consultant  to  weight  the  factors  included 
in  the  plan.   In  the  six  cases  mentioned  above  in  which  con- 
sultants were  used,  factor  weights  were  simply  accepted  along 
with  the  predetermined  plan. 


142 

Whether  an  individual  or  committee  is  used  in 
selecting  factors,  the  most  important  point  is  vAiether  the 
weights  contribute  to  the  validity  of  the  plan.  The 
ultimate  check  on  "correctness"  of  factor  weights  is  the 
validation  procedure. 

Five  of  the  point  plans  were  selected  in  order  to 
determine  \^ether  there  was  any  degree  of  consistency  in 
weightings  assigned  to  the  major  factor  classifications 
of  skill,  effort,  responsibility  and  working  conditions. 
Reference  to  Table  26  indicates  areas  of  similarity  and 
dis-similarity  in  factor  dstribution  amd  measurements. 
These  variations  in  factor  weightings  are  comparable  to  the 
findings  of  a  National  Industrial  Conference  Board  study 
in  1940.   In  this  instance  \^en  extreme  values  were  elim- 
inated, the  range  of  importance  for  skill  was  40  per  cent 
to  64.3  per  cent;  for  responsibility  20  per  cent  to  27.8 
per  cent;  for  effort  10  per  cent  to  21.0  per  cent?  and  for 
working  conditions  10  per  cent  to  20.0  per  cent. 

There  are  two  significant  points  of  departure  from 
the  industrial  study.   In  the  hospital  plans,  the  percentage 
value  associated  with  the  factor  "working  conditions"  is 
considerably  lower  than  that  for  the  industrial  plans. 
Also,  the  "responsibility"  factor  in  the  hospital  plans  is 


^Lytle,  op.  cit.,  p.  64. 
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TABLE  26 


INTER-HOSPITAL  COMPARISON  OF  FACTOR  WEIGHTINGS 


Factor 

Hospital  A 

Hospital  B 

Skill 

Education        26^ 
Experience       15% 

Education       25% 
Experience      15% 
Initiative  £e 
Judgment       10% 

41^ 

50% 

Responsibility 

Responsibility   20% 
Relationships    9^5% 
Supervision 
(a)#supervised    4% 
(b)Type  of 

supervision    4% 

Public 

Relations  12% 
Supervision  10% 
Confidential 

data  8^ 
EquiEwnent  & 

supplies  2% 
Accuracy        5%% 

37^ 

38% 

Effort 

Mental 

application     9*$% 
Physical 

application     6^ 

16?4 

Mental  effort   10% 
Physical  effort  2% 

12% 

Workinq 
Conditions 

Working 
environment      5% 

5% 

0% 

Total 

100% 

100% 
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TABLE    26— Extension 


Hospital  C 

Hospital  D 

Hospital  E 

Education  & 

Educational 

Education  & 

Training 

11% 

Requirement 

9% 

Training     22% 

Experience 

12% 

Experience 

Experience    17% 

Complexity  & 

requirement 

17% 

Initiative  & 

Judgment 

12% 

Initiative 

Judgment     23% 

requirement 

9% 

35?6 

35?i 

62?6 

Accuracy  &  effect 

Responsibility 

for 

Contacts      5% 

of  errors 

11% 

public  relations  6% 

Accuracy       4% 

Responsibility 

Responsibility 

for 

Responsibility 

for  personal 

materials,  prod- 

for work  of 

contacts 

6% 

ucts  money 

16% 

others       8% 

Responsibility 

Responsibility 

for 

Responsibility 

for  supervision 

supervision 

6% 

for  safety  of 

and/or 

Responsibility 

for 

others       4% 

admini  stration 

12% 

confidential 

Responsibility 

Responsibility 

data 

6% 

for  equipment  3% 

for  confidential 

information, 

money,  materials 

6% 

35?6 

34% 

24% 

Mental  effort 

12% 

Physical  effort 

Physical  demand  3% 

Physical  effort 

12% 

required 
Mental  effort 

9% 

Mental  demand  4% 
Emotional 

24?6 

required 

.^ 

demand        3% 

ii% 

10% 

Environment 

2% 

Working 

Working 

Job  hazards 

4% 

conditions 

8% 

conditions    5% 

Job  hazards 

6% 

6% 

1A% 

5% 

100% 

100% 

100% 
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accorded  a  considerably  larger  percentage  value  than  in 
the  Industrial  plans.   This  difference,  of  course,  would 
serve  to  emphasize  the  importance  of  the  "responsibility" 
concept  in  the  hospital  and  play  down  "working  conditions," 
a  factor  v^iich  would  normally  constitute  a  major  consid- 
eration in  the  industrial  plant. 

Whereas  there  seemed  to  be  at  least  some  degree 
of  consistency  in  the  apportioning  of  the  total  weight 
assigned  various  factors,  especially  %*ien  combined  into 
major  classifications,  a  study  of  the  distribution  of 
point  values  internal  to  each  factor  —  the  degree  values  — 
showed  little  or  no  relationship.   Prom  an  analysis  of  the 
factor  "education,"  for  example,  it  is  apparent  that  var- 
iations are  great  in  the  number  of  degrees  used,  degree 
point  rsmges,  and  the  ratio  of  first  degree  value  to  last 
degree  value  (see  Table  27).   Since  essentially  the  same 
jobs  are  being  studied  and  rated  from  one  institution  to 
another,  the  question  naturally  arises  as  to  vAiether  all 
of  the  measures  can  be  right  at  the  same  time.  Admittedly, 
some  variation  in  degree  values  might  be  warramted  because 
of  localized  conditions  or  circiomstances;  however,  the  ex- 
tent of  differences  shown  raises  possible  doubt  as  to  the 
validity  of  some  of  the  plans. 
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TABLE  27 


INTER-HOSPITAL  COMPARISON  OF  THE  FACTOR  "EDUCATION" 


Ratio  of  lowest  to 

Plan 

Point  Range 

No,  of  Degrees 

highest  degree  values 

A 

4  -  339 

9 

1  to  85 

B 

50  -  250 

6 

1  to  5 

C 

6-55 

7 

1  to  9 

D 

15  -   90 

6 

1  to  6 

E 

12  -  156 

13 

1  to  13 

F 

19  -  200 

9 

1  to  10 

G 

15  -   90 

6 

1  to  6 

*H 

*12  -  156 

13 

1  to  13 

I 

10  -   50 

5 

1  to  5 

J 

20  -  125 

6 

1  to  6 

K 

15  -   90 

6 

1  to  6 

L 

20  -  200 

7 

1  to  10 

M 

13  -  150 

8 

1  to  11  1/2 

N 

2-75 

7 

1  to  37  1/2 

O 

15  -   90 

6 

1  to  6 

P 

30  -  150 

4 

1  to  5 

Q 

20  -  120 

7 

1  to  10 

R 

40  -  150 

7 

1  to  3  2/3 

S 

13  -  150 

8 

1  to  11  1/2 

T 

14  -  70 

5 

1  to  5 

U 

7-70 

6 

1  to  10 

V 

3-53 

9 

1  to  18 

W 

14  -  70 

7 

1  to  5 

X 

20  -  120 

7 

1  to  10 

*Educatlon  and  training  combined. 

Source:  Hospital  Job  Evaluation  Survey. 
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TABLE  27--Extension 


Type  of 
Progression 


geometric 

arithmetic 

geometric 

eurithmetic 

arithmetic 

geometric 

arithmetic 

arithmetic 

arithmetic 

arithmetic 

arithmetic 

geometric 

geometric 

geometric 

arithmetic 

arithmetic 

geometric 

arithmetic 

geometric 

arithmetic 

arithmetic 

geometric 

geometric 

geometric 


Included  in  plan 


thru  administrator 

office,  clerical  and  unskilled 

all  but  department  heads  and  above 

\inskillcd  only 

thru  department  heads 

thru  administrator  but  does  not  cover 

x-ray,  lab,  tech,  and   pharmacists 
does  not  include  supervisors,  dept,  heads 

or  above 
thru  department  heads 
thru  department  heads 
thru  department  heads 

does  not  include  department  heads  or  above 
does  not  include  department  heads  or  above 
through  department  heads 
does  not  include  department  heads  or 

assistemt  department  heads 
thru  depaurtraent  heads 
maintencince  and  service  only 
thru  administrator 

does  not  include  department  heads  or  above 
thru  department  heads 

does  not  include  department  heads  or  above 
office,  technicians  and  unskilled 
thru  department  heads 
No  indication 
thru  administrator 
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With  reference  to  degrees  within  factors,  one 
other  point  Is  worthy  of  note.  A  study  of  the  point  plems 
submitted  suggests  little  variation  in  the  number  of  de- 
grees used  (see  Table  28).  As  might  be  expected,  the 

TABLE  28 

NUMBER  OF  DEGREES  FOR  MAJOR  FACTORS  USED  IN 
50  HOSPITAL  JOB  EVALUATION  PIANS 


Skill 

Complexity  of  Work  or  Analytical 
Requirements 

Experience 

Education 

Initiative  and  Judgment 

Responsibility  For 

Interpersonal  Relationships  or 
Personal  Contacts 

Confidential  Data 

Effect  of  Errors,  Dependability 
or  Accuracy 

Materials,  Products,  Supplies, 
Money  or  Equipment 

Safety  of  others  or  Patient 
Care  or  Safety 

Effort 

Physical  Application,  Demand 
or  Effort 

Mental  Application,  Demand  or 
Effort 


5 
5 
4 
4 

4 
4 


6 
12 
13 

8 

6 
6 


4-6 


3 
3 


-  6 


-  6 


6 
6 
7 
6 

6 
5 


3-7 


4-6 


6 
6 
6 
6 

6 
6 


6 
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TABLE  28 — Continued 


Factor 

Range 

Median 

Mode 

WorTcinq  Conditions 

Working  Environment  or  Job 
Conditions 

Accident  and  Health  Hazards  or 
Job  Hazards 

3-6 
4-6 

5 
5 

5 
6 

Source:   Hospital  Job  Evaluation  Survey. 

greatest  range  was  in  the  factors  "experience"  and  "edu- 
cation." Both  of  these  factors  constitute  important  facets 
of  the  more  technical  hospital  jobs.  Consequently,  an 
additional  range  of  degrees  was  added  to  take  care  of  this 
requirement* 

Acceptance  and  use  of  singalified  evaluation  plans 
by  the  hospital.   Since  a  progressive  change  leading  to  im- 
proved techniques  and  a  better  understanding  of  vAiat  job 
evaluation  can  be  e9q>ected  to  accomplish  may  be  desirable, 
hospitals  were  confronted  with  several  questions  relative 
to  the  use  of  a  more  scientific  approach  in  the  establish- 
ment of  their  respective  wage  plans.   Responses  to  the  first 
question  "have  you  ever  attempted  to  simplify  your  job 
evaluation  program,  that  is,  to  achieve  the  same  results 
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with  fewer  rating  factors"  seemed  to  suggest  that  little 
has  been  accomplished  in  this  area.  This  question  was 
confined  to  point  plans  in  effect  or  in  process  of  instal- 
lation since  it  had  reference  to  the  use  of  quantitative 
"factor  analysis."  Such  an   analysis,  for  purposes  of  re- 
ducing the  number  of  factors,  can  only  be  applied  to  the 
more  quantitative  systems  of  job  evaluation.  Excluding 
those  responses  \^ich  gave  no  answer  to  the  question,  84  per 
cent  of  hospitals  with  point  plans  in  effect  had  made  no 
attempt  to  reduce  the  number  of  factors  in  use.  Further- 
more, about  90  per  cent  of  those  in  the  process  of  in- 
stalling plans  were  not  attempting  to  shorten  the  plcui  (see 
Table  29) . 

T^BLE  29 

EXTENT  OP  USAGE  OP  PACTOR  REDUCTION  IN  HOSPITAL 

JOB  EVALUATION  PROGR/WS  (COMBINED 

SURVEY  RESULTS) 


Point  Plans 
In  Effect 

In  Process  of 
Installation 

Item 

Nimber 

Per  Cent 

Number 

Per  Cent 

Attempted  to  reduce 
no.  of  factors 

No  attempt  to  reduce 
no,  of  factors 

No  answer 

5 

32 

1 

13 

84 

3 

2 

18 

5 

8 

72 
20 

Totals 

38 

100 

25 

100 

Soxirces  Hospital  Job  Evaluation  Survey. 
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In  the  personal  survey  of  some  60  hospitals,  none 
of  those  currently  using  a  point  system  (12  hospitals)  had 
ever  attempted  to  simplify  through  "factor  analysis."  As 
a  matter  of  fact,  only  one  respondent  had  even  the  slightest 
familiarity  with  the  Lawshe  proposal.   In  the  mailed  sur- 
vey, seven  hospitals  (of  those  currently  using  or  in  pro- 
cess of  installing  a  point  system)  indicated  that  steps 
had  been  taken  to  reduce  the  number  of  factors?  however,  no 
indication  was  given  that  other  than  am   arbitrary  reduction 
was  made.  Only  two  respondents  mentioned  the  use  of  "factor 
analysis. "  One  personnel  administrator  suggested  that  he 
had  had  contact  with  Lawshe  *s  work  v*iile  employed  in  in- 
dustry. At  the  time  he  was  thinking  about  applying  such  a 
procedure  to  the  plan  in  operation  at  his  hospital.  The 
other  respondent,  although  feuniliar  with  Lawshe  *s  system, 
stated  that,  in  his  opinion,  "the  Lawshe  proposal  goes  to 
the  extreme."  Admittedly,  usage  of  a  restricted  number  of 
factors  has  not  gained  wide  acceptance;  ho%«ever,  this  might 
well  be  attributed  to  the  natural  resistance  to  change  or 
to  a  general  lack  of  knowledge  and  understanding  of  abbre- 
viated plans.  Whatever  the  reason,  hospitals  have  evi- 
dently not  made  use  of  an  abbreviated  plan.   In  all  fair- 
ness, however,  it  should  be  mentioned  that  neither  have 
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they  gone  off  the  deep  end  in  canplicating  the  system  with 
many  factors.   Inasmuch  as  job  evaluation  is  not  well  en- 
trenched in  the  hospital  field,  perhaps  the  resistance  to 
cheinge  will  not  be  so  strong  as  it  has  been  in  the  indus- 
trial sitioation. 

Again,  the  central  issue  does  not  relate  to  the 
absolute  nturiber  of  factors  used.  The  important  issue  is 
whether  those  factors  and  wei^ts  used  constitute  a  valid 
system.  Even  if  the  number  of  factors  is  arbitrarily  re- 
duced and  a  trial  and  error  procedure  is  applied  in  deter- 
mining proper  factor  weights,  the  system  is  a  useful  one 
if  rating  results  give  a  high  degree  of  correlation  with 
the  external  criteria. 

Extent  of  hospital  usage  of  reliability  checks  on 
the  job  evaluation  plam.   Program  reliability  is  cuiother 
facet  of  the  more  scientific  approach  to  job  evaluation 
on  which  the  hospitals  were  questioned.   In  essence,  re- 
lizibility  of  the  job  rating  refers  to  the  consistency 
with  which  total  point  scores  for  individual  Jobs  may  be 
expected  to  be  assigned  xinder  the  same  set  of  known  con- 
ditions.^ Basically,  rater  reliability  may  be  ascertained 


Dale  Yoder,  Personnel  Principles  and  Policies 
(Englewood  Cliffs,  New  Jersey:  Prentice-Hall,  Inc.,  1952), 
p.  464. 
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for  the  Individual  or  the  group;  howevrer,  methodology  is 
much  the  same  in  either  instance.   Under  present  circum- 
stances, inter-rater  reliability  is  of  chief  concern  to 
the  hospita*  nevertheless,  with  the  continued  growth  of 
the  concept  of  Job  evalxiation  in  the  hospital  field,  the 
idea  of  inter-hospital  program  reliability  will  assume 
added  importance. 

In  the  area  of  reliability,  hospitals  have  made 
substantial  progress.   Since  any  type  of  job  evaluation 
system  is  subject  to  reliability  checks,  answers  to  the 
question  on  reliability  were  tabulated  for  all  responding 
hospitals  using  Job  evaluation.  A  little  less  than  60  per 
cent  (57  of  98)  indicated  that  some  check  on  the  reli- 
ability of  the  ratings  had  been  made  (see  Table  30). 


TABLE  30 

EXTENT  OF  USAGE  OP  RELIABILITY  CHECKS  ON 
HOSPITAL  JOB  EVALUATION  PLANS 
(COMBINED  SURVEY  RESULTS) 


Item 


System  checked  for  reliability 
System  not  checked  for 

reliability 
No  answer 

Total 


All  Formal  Evaluation  Plans 


Nuniber 


Per  Cent 


58 

35 

7 


100 


sources   Hospital  Job  Evaluation  Survey, 


154 

Restricting  the  study  solely  to  point  plans  in 
effect,  of  the  38  hospitals  reporting  current  usage  of  such 
a  quantitative  evaluation  system,  25  (approximately  66  per 
cent)  reported  that  some  means  of  checking  on  program 
reliability  had  been  undertaken.  This  is  somevAiat  higher 
than  for  all  types  of  formal  job  evaluation  plans;  however, 
there  remains  a  wide  latitude  within  \diich  improvement  may 
be  made. 

In  an  effort  to  ascertain  just  how  those  hospitals 
reporting  some  check  on  system  reliability  accomplished 
this  task,  the  question  "have  you  made  scnne  check  upon 
the  reliability  of  your  system  —  that  is  the  consistency 
with  v^ich  you  can  use  it  from  time  to  time  for  the  saune 
jobs  or  the  same  consistency  with  v^ich  you  and  others 
using  it  independently  on  the  same  jobs  come  up  with  the 
same  results"  was  included  in  the  supplementary  letter  sent 
to  all  point  plzm  users.   Twenty  hospitals  responded  to 
the  sxibsequent  communication.   In  addition,  12  hospitals 
using  a  point  plan  responded  to  the  question  during  the  per- 
sonal survey.   In  each  instance  in  v^ich  an  affirmative 
answer  was  given  to  the  question  on  reliability  (18  of  32, 
or  57  per  cent) ,  a  simple  inter-rater  test  was  landertaken. 
That  is,  "key"  jobs  were  rated  independently  and  then  cora- 
paored  for  discrepancies  among  the  raters  involved. 
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Although  a  slgnificemt  number  of  hospitals  are 
checking  their  evaluation  plans  for  reliability,  slightly 
more  than  one-third  replied  that  no  such  check  vas  made. 
Failiire  to  test  for  relieOjility  may  lead  directly  to  a 
non-valid  system  since  reliability  and  validity  are  comple- 
mentary.  In  essence,  reliability  is  a  prerequisite  to 
validity. 

Extent  of  hospital  usage  of  validity  checks  on  the 
job  evaluation  plan.  Not  only  must  the  evaluation  plan 
stress  reliability  of  items  and  raters,  it  is  equally 
necessary  that  the  validity  of  the  plan  be  ascertained. 
As  a  matter  of  fact,  there  exists  a  high  degree  of  inter- 
relationship between  the  two  concepts.   It  is  a  generally 
accepted  fact  that  "accuracy  of  measurement  (or  What  is 
the  statistical  concept  of  validity)  cannot  exist  without 
reliability.  A  high  degree  of  reliability  does  not  in  it- 
self insure  a  corresponding  degree  of  validity,  but  the 
•ceiling*  of  the  validity  possible  in  a  given  situation  is 
determined  by  a  statistical  relationship  with  the  reli- 
ability."  In  the  same  vein,  Guilford  proposes  the  idea 
that  "practical  validity  of  a  test,  other  things  being 


Lawshe  emd  McCormidc,  op.  cit.,  p.  105. 
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equal,  is  directly  proportional  to  its  reliability  —  the 
more  reliable  a  test,  the  more  valid  it  is.**-*-  It  is 
reasonable  to  assiame  that  the  same  relationship  would  ob- 
tain for  the  job  evaluation  plan.   Essentially,  then,  every 
effort  should  be  made  to  assess  both  the  reliability  and 
the  validity  of  the  hospital  evaluation  plan  if  the  racucimxim 
value  accruing  from  either  is  to  be  realized. 

In  both  the  personal  contact  with  hospitals  and  the 
mailed  survey  the  question  was  asked  "did  you  use  statistical 
measures  to  validate  your  job  evaluation  plan."   The 
question  pertained  only  to  those  institutions  employing  a 
point  plan  of  evaluation.   There  was  a  rather  high  number  of 
positive  responses.   Of  the  point  plans  in  effect,  20  (53 
per  cent)  indicated  that  some  means  of  validating  the  sxib- 
jective  system  was  undertaken  vdiile  17  or  (45  per  cent)  re- 
plied negatively.   One  respondent  failed  to  reply  (see 
Table  31) .   The  response  was  even  more  favorable  from  those 
hospitals  cvirrently  installing  a  job  evaluation  plan.   In 
this  case  (excluding  the  seven  respondents  Who  failed  to 
reply)  13  (72  per  cent)  replied  in  the  affirmative  and   only 
five  (28  per  cent)  indicated  that  no  validation  was  atteit^ted. 


■'-Guilford,  op.  cit.,  p.  470. 
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TftBLE  31 


EXTENT  OF  USAGE  OF  VALIDITY  CHECKS  ON  HOSPITAL 
JOB  EVALUATION  PLANS  (COMBINED 
SURVEY  RESULTS) 


Point  Plans 
In  Effect 

Point 
Being 

.  Plans 
Installed 

Item 

Number 

Per  Cent 

NvuTiber 

Per  Cent 

system  validated 
system  not  validated 
No  answer 

20 

17 

1 

53 

45 

2 

13 
5 
7 

52 
20 
28 

Totals 

38 

4 

100 

25 

100 

Source:   Hospital  Job  Evalxiation  Survey, 


In  order  to  seek  a  more  detailed  analysis  of  these 
responses,  several  questions  regarding  program  validity 
vere  included  in  a  supplementary  letter.   In  addition, 
administrators  were  questioned  on  this  point  during  the 
personal  survey.   Looking  first  at  the  point  plans  already 
in  effect,  of  the  38  plans,  20  responses  to  the  letter  were 
received  by  mail  plus  12  by  personal  interview.  Five  of 
these  plans  used  a  scatter  diagram  to  plot  internal  points 
against  external  wage  rates  for  the  same  jobs  or  at  least 
used  external  wage  data  as  a  criterion.   This  approach  re- 
presents a  gross  measure  of  program  validity;  however,  in 


158 
only  one  case  vas  a  correlation  coefficient  developed  for 
possible  inter-hospital  ccaoparison.   Twelve  institutions 
stated  that  internal  points  were  correlated  with  internal 
wages  as  a  mesuis  of  estad^lishing  validity.   It  is  impossible 
for  the  results  of  such  action  to  contribute  to  program 
validity  since  the  criterion  must  of  necessity  be  inde- 
pendent of  the  thing  being  measured  (i.e.,  internal  wage 
rates) .   This  is  one  of  the  most  frequent  pitfalls  con- 
fronting those  ascribed  the  responsibility  of  testing  for 
validity  of  the  job  evaluation  plan.   Such  a  course  of  action 
fails  to  satisfy  the  need  for  an  independent  measure  for 
use  in  testing  results  of  the  evalviation  program.  For- 
tunately, such  external  independent  criteria  are  available 
In  most  cases  so  that  adequate  measures  of  hospital  Job 
evaluation  programs  are  readily  obtainable.   Eight  other 
plems  stressed  the  use  of  both  internal  £md  external  wage 
rates  in  atten^ting  to  validate  the  program.  This  pro- 
cedure is  s\jbject  to  the  same  limitations  as  that  of  using 
only  internal  wage  rates  as  criteria. 

Apparently  most  hospital  personnel  managers  are  not 
aware  of  ^^at  validity  of  the  Job  evaluation  prograun  really 
involves.  For  example,  20  of  those  reporting  that  validity 
checks  had  been  made  indicated  that  internal  wage  rates 
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had  been  used  as  criteria.   Such  a  procedure  does  not  con- 
stitute a  validity  check  on  anything.  As  a  matter  of 
fact,  to  use  such  a  method  is  viorse  than  not  checking  the 
plan  for  validity  at  all  since  false  premises  may  be  drawn 
concerning  the  rightness  of  the  plan.   The  results  would 
be  entirely  misleading. 

Only  five  responses  were  received  from  hospitals 
reporting  that  a  point  plan  was  in  the  process  of  being 
Installed.   Perhaps  the  stage  of  program  development  did 
not  permit  am  answer  to  the  detailed  questions  submitted. 
Nevertheless*  three  of  the  responses  received  indicated  the 
use  of  a  scatter  diagram  using  internally  developed  points 
correlated  with  external  wage  rates  for  the  same  Jobs.  One 
hospital  reported  that  internal  wage  rates  were  used  to 
correlate  with  rating  points  and  another  plan  used  only  a 
single  job  (with  its  corresponding  external  wage  rate)  as 
the  basis  for  developing  its  rate  progression.   Such 
activities  can  in  no  wise  be  considered  to  be  validation 
procedures.   Nevertheless,  those  responding  to  the  question 
on  validity  apparently  felt  that  such  procedures  did  consti- 
tute a  validity  check.   The  development  of  measures  per- 
mitting inter-hospital  comparison  of  validity  coefficients 
has  not  yet  occurred.   It  is  hoped  that  this  study  will  stim- 
ulate additional  thinking  along  these  lines. 
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Problems  faced  by  hospitals  in  operating  and  con- 
trolling the  job  evaluation  plan.   Since  job  evaluation  of 
necessity  must  involve  certain  areas  of  discretion  and 
opinion,  it  is  not  unlikely  that  problems  relating  to 
individual  interpretation  will  be  encountered.   Since 
individuals  would  normally  tend  to  see  the  same  set  of 
conditions  or  factors  in  a  different  light,  depending,  of 
course,  upon  the  degree  of  diversity  in  their  background 
and  training,  it  is  expected  that  variation  of  opinion 
will  show  up  in  the  job  evaluation  results.   It  is  possible, 
however,  to  eliminate  a  considerable  portion  of  this  incon- 
sistent thinking  by  carefully  controlling  the  training 
process  and  by  following  through  with  reliability  checks. 

In  answer  to  the  question  "what  are  the  major 
operating  problems  encountered  in  your  plan,"  more  hospitals 
reported  "difficulty  of  insuring  uniform  interpretation  of 
the  program"  them  any  other  problem.  Whether  this  particular 
difficulty  resulted  from  a  lack  of  promulgation  of  infor- 
mation prior  to  program  implementation  or  from  lack  of 
proper  training  in  usage  of  the  program  or  both  is  a  moot 
question.  However,  the  frequency  of  the  response  serves 
notice  as  to  the  seriousness  of  the  problem. 
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Two  other  basic  operating  problems  related  to 
(1)  getting  changes  In  Jobs  and  new  Jobs  reported  promptly, 
and  (2)  lack  of  experienced  personnel  to  administer  the 
plan.  Either  of  these  problems  can  effectively  destroy 
the  effectiveness  of  the  program.  Failure  to  keep  abreast 
of  job  changes  means  that  actual  job  content  is  not 
accurately  reflected  in  the  wage  paid  that  job.   The  ser- 
iousness of  the  problem  relating  to  lack  of  experienced 
personnel  to  operate  the  plan  is  obvious.   It  is  doubtful 
that  the  program  can  stirvive  at  all  under  such  a  condition. 

Reference  to  Table  32  will  suggest  the  frequency  with 
which  other  problems  of  a  lesser  nature  were  encountered  by 
responding  hospitals.   It  is  interesting  to  note  that  one 
of  the  relatively  important  problems  reported  by  responding 
hospitals  relates  to  the  difficulty  in  keeping  the  admin- 
istrator auid  the  supervisory  group  "sold"  on  Job  eval- 
uation. Perhaps  this  difficulty  stems  from  the  fact  that 
the  program  has  proven  somev^at  less  than  successful 
either  because  the  individuals  mentioned  were  not  completely 
"sold"  on  the  plan  initially  or  they  were  left  out  in  the 
construction  and  implementation  of  the  evaluation  plan. 

In  another  section  of  the  survey  sheet,  a  question 
vras  asked  concerning  the  degree  of  satisfaction  %d.th  the 


162 


TABLE  32 


PROBLEMS  ENCOUNTERED  IN  OPERATING  THE  JOB 
EVALUATION  PLAN  IN  THE  HOSPITAL 
(MAILED  SURVEY  RESULTS  ONLY) 


Item 


Frequency  of 
Response 


Insuring  uniform  interpretation  of  the  program      64 
Pressure  to  increase  Individual  rates  above 

evaluated  rates  54 

Getting  changes  in  Jobs  and  new  Jobs  reported 

promptly  49 

Lack  of  experienced  personnel  to  administer  the 

plan  40 

Keeping  Administrators  and  supervisory  group 

"sold"  on  Job  evaluation  27 

Keeping  everyone  Informed  on  changes  that  occur 

in  the  progrsun  17 

Efficient  and  effective  hemdling  of  rate  grievemces  12 
Others  (Listed  once  each) t  Keeping  clerical  detail 
up  to  date;  Acceptance  of  ratings  by 
department  heads;  Being  able  to  afford  to 
bring  rates  in  line  with  community;  Train- 
ing time  necessary;  Tirying  to  Incorporate 
top  level  jobs  in  the  program;  Civil  Ser- 
vice Commission) .  6 
Lack  of  time  3 


Total  272* 


Source:   Hospital  Job  Evaluation  Survey, 

^Exceeds  total  plans  as  hospitals  checked  more  than 
one  item. 


evaluation  plan  and  the  reason  or  reasons  for  the  choice. 

In  numerous  Instances,  criticisms  reflected  certain  operating 

problems  encountered  in  Implementing  the  plan.  One  of  the 
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most  frequently  mentioned  difficulties  related  to  failure 
to  keep  the  job  evaluation  plan  up  to  date  either  because 
of  lack  of  time  or  sufficient  interest  in  keeping  the  pro- 
gram current.   Another  problem  area  related  to  the  attempt 
by  professional  groups  in  the  hospital  to  apply  pressure  to 
raise  salaries  above  the  evaluated  rate.   Once  pressure 
from  professional  groups  is  allowed  to  prostitute  the  wage 
structure,  the  Job  evaluation  program  is  as  good  as  dead. 
Giving  in  to  one  such  demand  leads  to  other  demands  until 
the  wage  structure  bears  no  relationship  to  that  established 
through  the  impartial  system  of  evaluation.   In  this  same 
general  area,  some  difficulty  was  encountered  in  trying  to 
operate  the  evaluation  plan  yihen   there  was  a  union  in  the 
hospital.   However,  such  a  problem  was  not  widely  en- 
countered since  few  hospitals  have  been  unionized  at  the 
present  time.  As  a  matter  of  fact,  a  fair  and  equitable 
Job  evaluation  plan  tends  to  diminish  the  need  for  unions 
to  represent  hospital  employees.   Several  institutions  sug- 
gested that  it  was  difficult  to  keep  salaries  in  line,  based 
on  the  Job  evaluation,  because  of  the  shortage  of  technical 


See  Helen  Baker  and  John  M.  True,  The  Operation  of 
Job  Evaluation  Plans  (Princeton:   Princeton  University, 
Industrial  Relations  Section,  1947),  pp.  46-48,  for  a  de- 
tailed discussion  of  these  same  problems  as  encountered  in 
the  industrial  situation. 
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or  professional  personnel.  On  the  other  hand,  criticism 
was  raised  because  the  plan  prevented  a  proper  adjustment 
of  rates  in  order  to  recruit  technical  personnel.  Here 
again,  the  evaluation  study  will  probably  uncover  situations 
\^ere  jobs  in  short  supply  will  be  overpriced.  This  does 
not  negate  the  value  of  the  program.  Under  such  a  con- 
dition, the  evaluation  progrzun  points  out  such  problem 
areas  so  that  the  hospital  can  establish  training  pro- 
grams or  take  scnne  other  course  of  action  to  alleviate  the 
scarcity  v^ere  possible.  Furthermore,  the  evaluation  plan 
alerts  the  administration  to  which  jobs  are  out-of-line 
because  of  market  conditions  so  that  action  may  be  taken 
to  bring  such  jobs  back  into  line  when  changes  in  the 
market  conditions  permit. 

Another  hospital  reported  encountering  difficulty 
in  trying  to  include  the  supervisory  and  highly  skilled 
personnel  in  the  same  program  with  the  rank-and-file 
employees.   Such  a  problem  would  be  of  little  consequence 
if  an  adequate  evaluation  plan  were  used.   Several  of  the 
most  progressive  hospitals  used  a  single  plan  to  cover  all 
employees  up  to  and  including  the  administrator.   It  is  quite 
possible  to  use  separate  plans  for  different  classes  of 
workers;  however,  such  a  procedure  increases  the  complexity 
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of  operating  the  overall  program.   In  addition,  employees 
tend  to  feel  that  wage  discrimination  Is  being  practiced 
if  they  are  not  Included  in  the  same  plan  with  the  pro- 
fessional and  office  personnel.   One  respondent  reported 
that  the  program  was  weak  in  that  inconsistencies  in  rating 
appeared  v*ien  a  committee  rated  jobs.   This  difficulty, 
of  course,  related  to  reliability  of  the  rating  process 
and  might  easily  have  been  tested  for.   Admittedly,  these 
operating  problems  may  be  encountered;  however,  in  certain 
instances,  problems  are  created  through  improper  develop- 
ment and  installation  of  the  plan.  Although  all  possible 
difficulties  cannot  be  anticipated,  mamy  of  the  compli- 
cating factors  may  be  reduced  or  eliminated  altogether 
through  sound  analysis  of  the  existing  situation.   The 
succeeding  chapter  is  devoted  to  suggesting  means  of  pre- 
plaiming  which  will  effectively  forestall  many  of  the 
above  mentioned  problem  areas. 

Centralization  of  control  over  the  operation  of 
the  job  evaluation  program  assures  the  meeting  of  pur- 
poses and  objectives  as  outlined  in  the  original  plan. 
Since  changes  will  frequently  be  encountered  in  any  one 
of  a  number  of  areas  directly  associated  with  the  daily 
operation  of  the  evaluation  plan,  some  means  must  be 
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provided  for  handling  these  changes  as  adequately  and  as 
rapidly  as  possible.  According  to  Michael:   "Without  the 
guidance  and  controlling  influence  of  an  impartial  central 
department  there  sometimes  develops  in  various  organi- 
zations different  'yardsticks*  as  to  vAien  pranotions  should 
be  made,  when  changes  in  job  titles  and  job  values  are 
Justified  and  as  to  vdiat  salary  rate  treatment  should  be 
accorded  vflien  changes  are  made.   The  clearing  of  all  such 
changes  through  a  central  department  can  do  much  to  insvure 
uniform  treatment  throughout  the  entire  organization." 

Apparently  hospitals  which  have  instituted  point 
plans  of  job  evaluation  have  recognized  the  need  for  estab- 
lishing a  central  agency  through  Which  all  operating 
changes  will  flow.   In  response  to  a  question  relative  to 
the  person  or  area  administering  the  plan,  each  of  the  84 
respondents  reporting  use  or  impending  use  of  a  point  plan 
stated  that  provision  had  been  made  for  centralized  control. 
In  a  large  majority  of  cases  (72  per  cent)  this  control  was 
centralized  in  the  Personnel  Director  or  his  assistant.   In 
some  few  instances  the  administrator  or  his  assistant  was 


L,  B.  Michael,  ""The  Administration  of  Job  Eval- 
uation and  Salary  Standardization,"  in  Dooher  and  Marquis, 
op.  cit.,  p.  85. 
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assigned  the  responsibility  for  seeing  that  proper  control 
vas  exercised;  however,  in  view  of  the  multiplicity  of 
duties  and  responsibilities  of  the  Administrator,  it  is 
highly  unlilcely  that  adequate  operational  control  will  be 
forthcoming.   The  degree  to  which  centralized  control  of 
the  Job  evaluation  plan  has  been  assigned  to  the  personnel 
area  is  significantly  higher  for  hospitals  thsm  for  banks, 
depEurtment  stores  or  industrial  concerns.  This  fact  would 
suggest  that  control  of  the  evaluation  plan  in  the  hospital 
may  be  most  adequately  handled  by  the  personnel  staff,  in 
conjunction  with  line  administrators,  ina^nuch  as  they  are 
already  charged  with  the  responsibility  for  many  problems 
directly  and  indirectly  related  to  wage  and   salary  admin- 
istration. However,  since  personnel  constitutes  a  staff 
activity,  any  policy  changes  or  radical  departure  frcro  set 
policy  should  be  made  only  with  approval  of  line  adminis- 
trators.  It  is  essential  that  the  administrator  retain 
the  final  authority  eind  responsibility  for  control  of  the 
hospital • s  evaluation  plan  and  that  he  be  made  chairman  ex 
officio  of  the  review  committee.  Nevertheless,  time  limi- 
tations make  it  necessairy  that  operational  control  be 
delegated  to  the  personnel  group,  subject  to  the  limitations 
noted  above. 


CHAPTER  IV 

MAJOR  CONSIDERATIONS  IN  DEVELOPING  A  POINT 
PLAN  OP  JOB  EVALUATION  FOR  HOSPITALS 


General  Statement  of  Purpose 

The  principal  purpose  of  this  chapter  Is  to  develop 
a  framework  of  principles  and   concepts  to  serve  as  a  useful 
guide  In  the  development  and  Implementation  of  a  job  eval- 
tiatlon  program  In  the  Individual  hospital.   To  assist  In 
accomplishing  this  objective,  a  master  plem  for  rating 
hospital  jobs  Is  offered.   The  development  of  an  evaluation 
plan  to  be  used  in  any  type  of  hospital  Is  possible  since 
a  great  deal  of  similarity  exists  In  the  functions  carried 
on  by  Indlvldxial  hospitals.  Caution  should  be  exercised, 
however.  In  making  certain  that  each  hospital  undertakes  to 
validate  the  plan  Individually  before  use  In  rating  Its 
unique  jobs.  Extensive  use  Is  made  of  the  results  of  the 
hospital  job  evaluation  survey  In  the  subsequent  develop- 
ment of  the  evaluation  plan  for  the  hospital.  Wherever 
possible,  hospital  tested  techniques  vdilch  have  proven 
successful  over  a  period  of  time  are  brought  to  attention, 
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In  other  Instances,  concepts  vihich  would  serve  to 
strengthen  the  evaluation  plem  will  be  stressed.   This  is 
particularly  true  with  respect  to  the  more  scientific 
methods  of  program  develofwient  which  are  not  in  wide  usage 
in  hospitals  at  present. 

The  quantitative  point  system  of  job  evaluation 
will  be  used  in  the  development  of  a  master  plan  for  the 
hospital.   Use  of  this  type  of  plan  is  made  for  several 
reasons.   In  the  first  place,  point  plans  tend  to  dominate 
the  picture  for  both  industrial  concerns  and  service  insti- 
tutions.  Furthermore  their  usage  appears  to  be  in  the 
ascendency.  A  second  and  more  Importamt  reason  relates 
to  the  absolute  need  for  testing  the  Job  evaluation  plan 
for  validity  2md  reliability.   The  quemtitative  aspect  of 
the  point  plan  lends  itself  admirably  to  the  accomplish- 
ment of  this  objective.   Lastly,  the  use  of  the  more  quan- 
titative system  is  required  if  amy  scientific  approach  to 
factor  reduction  is  to  be  undertaken. 

In  terms  of  validating  the  rating  plan,  the  point 
system  of  Job  evaluation  possesses  unique  qualifications 
vrtiich  make  it  superior  to  either  the  factor  comparison  or 
classification  plans.   Primarily,  the  point  plan  rates  Jobs 
independently  of  either  internal  or  external  wage  rates. 
Their  relative  values  are  stated  in  terms  of  total  point 
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values.  Such  measures  lend  themselves  readily  to  compari- 
son vdth  the  independent,  quemtitative  external  criteria 
of  market  wage  rates  in  ascertaining  the  validity  of  the 
rating  plan.  Factor  comparison  plans,  on  the  other  hand, 
constitute  a  direct-to-money  method  of  evaluating  jobs. 
The  evaluation  scales  are  expressed  in  monetary  units 
rather  than  in  some  unit  independent  of  wages.  As  a  re- 
sult, since  job  values  are  already  stated  in  monetary  terms 
%*hich  are  assvuned  to  express  the  true  worth  of  the  job, 
there  is  no  basis  for  independent  comparison  with  the  ex- 
ternal criteria  of  market  wage  rates.  In  effect,  the  vali- 
dation criteria  are  built  into  the  system.  Since  the  factor 
comparison  plan  cannot  meet  the  requirements  of  the  vali- 
dation process,  its  use  is  discovmted  in  favor  of  the  point 
plan. 

Th3  other  principal  type  of  job  evaluation  plan, 
job  classification,  also  offers  limited  possibilities  as 
far  as  validation  is  concerned.  Little  more  than  a  gross 
measure  of  the  comparison  of  job  ranks  with  external  wage 
rates  is  possible.  Such  an  approach  leaves  much  to  be  de- 
sired.  In  short,  the  most  acceptable  and  useful  evaluation 
plan  for  the  hospital  is  the  point  plan.  Consequently,  all 
ftirther  discussions  concerning  a  plan  of  evaluation  will  re- 
fer to  the  point  plan. 
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Preliminary  Plannlng-Admlnlstrative  Decision 
The  hospital  administrator's  decision 

Inasmuch  as  wages  and  salaries  account  for  65  to 
70  per  cent  of  the  total  cost  of  operating  the  hospital, 
the  administrator  should  be  vitally  concerned  with  a  pro- 
gram devoted  to  creating  an  equitable  wage  program. 
Traditionally  the  development  of  wage  rate  ranges  has  been 
influenced  by  any  number  of  factors  including  internal  and 
external  group  pressure,  precedent  cuid  tradition  as  well 
as  decision  by  fiat  on  the  part  of  management.   Such  pro- 
cedTires  undoubtedly  pave  the  way  for  inequities  v^iich, 
in  txirn,  may  create  serious  internal  disturbances  in  the 
hospital.   The  decision  to  install  a  well-planned,  valid 
job  evaluation  plan  in  the  hospital  constitutes  sound 
management  practice  on  the  part  of  the  administrator. 

It  is  important  that  the  decision  to  use  job  eval- 
uation be  made  by  the  top  administrator  in  cooperation 
with  the  hospital's  Board  of  Trustees.   Since  the  eval- 
uation plan  will  involve  the  entire  institution,  orig- 
ination of  the  plan  on  a  lower  eschelon  will  fail  to 
elicit  the  necessary  support.   Furthermore,  even  if  the 
administrator  initiates  the  program  and  then  fails  to 
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lend  continuing  active  support,  it  will  more  than  likely 
"wither  on  the  vine."  Active  support  entails  the  use  of 
a  formal  memorandum  from  the  administrator  to  subordinates 
and  other  employees  acknowledging  his  support  of  the  pro- 
gram and  seeking  their  active  cooperation.  As  the  program 
gets  under  way,  appearamce  of  the  administrator  at  formal 
meetings  v^ere  the  Job  evaluation  plan  is  being  discussed 
further  emphasizes  the  fact  that  the  program  has  his  full 
backing  and  cooperation.  These  activities  should  not  be 
delegated  to  subordinates  since  the  final  responsibility 
for  the  job  eval\iation  plan  rests  solely  with  the  admin- 
istrator. 

Secxirinq  assistance  in  program  development 

Once  the  decision  is  made  to  accept  and  utilize  job 
evaluation,  the  administrator  must  decide  vrtiether  to  make 
use  of  an  outside  consultant,  secure  the  cooperation  and 
assistance  of  the  local  hospital  coxmcil  or  try  to  estab- 
lish the  plan  utilizing  existing  hospital  personnel.   If 
there  is  no  one  in  the  hospital  who  has  had  any  experience 
with  job  evaluation,  the  feasibility  of  proceeding  without 
assistance  is  doubtful.  On  the  other  hand,  since  most  in- 
dustrial consulting  firms  are  not  fzuniliar  with  the  unique 
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problems  of  the  hospital,  adequate  assistance  may  not  be 
forthcoming  from  this  source.   In  the  event  the  decision 
is  made  to  employ  an  outside  consultant  to  hemdle  the 
hospital's  Job  evaluation  program,  care  should  be  taken  to 
see  that  he  understands  the  concept  of  validating  the 
plan.  As  a  matter  of  fact,  this  should  be  the  primary 
criterion  in  selecting  a  consultant.  Although  he  may  be 
able  to  establish  a  rating  plan  for  the  hospital  in  a 
ccKirparatively  short  period  of  time,  unless  such  a  plan  is 
validated,  it  will  be  no  better  than  any  other  plan  that 
the  hospital  might  adopt  in  toto.  Under  such  a  condition 
the  hospital  faces  a  costly  mistake. 

The  most  fruitful  approach  is  for  the  administrator 
to  work  through  the  local  hospital  coxincil  in  establishing 
a  workable  plan  of  evaluation  for  the  hospital.  Such  an 
approach  is  especially  good  if  several  hospitals  cooperate 
in  requesting  the  coxincil  to  engage  personnel  experienced 
in  handling  hospital  job  evaluation  programs.  Each  insti- 
tution should  be  considered  on  an  individual  basis  in 
implementing  the  program  of  evaluation.  However,  the  over- 
all program  should  be  coordinated  through  the  hospital 
covmcil  with  the  evaltiation  group  working  independently  of 
any  individual  administrator. 
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The  evaluation  group  should  be  given  the  principal 
responsibility  for  training  selected  hospital  personnel  In 
the  develojHnent  and  Implementation  of  the  evaluation  pro- 
gram preparatory  to  its  initiation.   They  should  be  re- 
tained until  the  program  is  functioning  effectively. 
Thereafter,  best  practice  dictates  that  the  operation  of 
the  plan  be  left  to  the  individual  hospital  personnel 
department.   If  the  evaluation  group  has  done  a  good  Job 
in  training  the  selected  hospital  personnel  and  if  such 
personnel  have  gained  sufficient  experience  through  assisting 
the  evaluation  group  in  developing  the  plan,  little  diffi- 
culty should  be  estperienced  in  day-to-day  operations.  Under 
all  circumstances,  however,  a  coordinator  should  be  selected 
by  each  hospital  to  work  full-time  with  the  evaluation 
group.  After  completion  of  the  project,  in  order  to  insure 
continuity,  the  coordinator  should  be  assigned,  at  least 
part-time,  to  keep  the  program  current.  This  In^ortant 
idea  is  developed  further  later  in  this  chapter. 

Concurrent  Planning  -  Develop«nent  of  the  Rating  Plan 

Once  the  administrative  decision  has  been  made  to 
Institute  a  Job  evaluation  program  and  the  evaluation  group 

■'•See  page  184. 
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has  been  retained  to  train  selected  members  of  the  hospital 
personnel  department  and  to  assist  in  developing  the  program, 
the  problems  of  developing  a  rating  plan  become  paramount. 
In  the  event  the  hospital  has  already  established  a  point 
plan,  it  is  unnecessary  that  the  plan  be  scrapped  in  its 
entirety.  As  a  matter  of  fact,  the  plan  as  it  stands  may 
be  entirely  valid.  However,  validity  should  never  be  as- 
sumed. A  specific  analysis  of  its  validity  should  be  under- 
taken.  If  the  plan  proves  to  be  invalid,  necessazry  modifi- 
cations should  be  made  in  factor  weightings  and  another 
check  made  on  the  plzm's  validity. 

In  the  event  the  hospital  does  not  have  a  point  plan 
in  operation  two  alternative  courses  of  action  are  available. 
One  of  the  standard  plans  of  Job  evaluation  may  be  selected 
for  use  or  an  entirely  new  rating  plan  may  be  developed  to 
meet  the  hospital's  requirements.   There  are  several  stand- 
ard job  evaluation  plans  presently  in  use;  however,  a  study 
of  these  plans  reveals  that,  in  some  instemces,  they  are 
inadequate  to  handle  the  entire  range  of  jobs  in  the  hos- 
pital.  Furthermore,  several  of  the  plems  omit  factors  that 
are  essential  to  a  complete  rating  of  jobs.  To  offset  these 
difficulties,  the  hospital  has  the  further  option  of  con- 
structing its  own  plan  based  on  the  fundamental  principles 
of  job  measurement  or  of  making  use  of  the  standard  master 
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rating  plan  presented  below.  Acceptance  and  use  of  this 
plan  would  eliminate  the  above  mentioned  difficulties, 
reduce  the  problems  inherent  in  development  of  a  plan  from 
the  ground  up  and«  if  used  widely  enough,  would  facilitate 
inter-hospital  comparisons. 

TABLE  33 

MASTER  FATING  PLAN  FOR  USE  /  "^  ?: 

IN  RATING  HOSPITAL  JOBS       ^JJ2^  ^   ^ 

Factors  Degrees 

1234567  8  9 


Skill 


Education 

15 

26 

34 

46 

62 

83 

111 

149 

Experience 

15 

21 

29 

40 

56 

77 

108 

150 

Initiative 

and  judg- 

ment re- 

quired 

15 

21 

29 

40 

56 

77 

108 

150 

Responsibility 

for 

Patient  care 

■ 

and  safety 

10 

15 

26 

49 

67 

90 

Personal  con- 

- 

tacts  and 

public  re- 

lations 

10 

15 

26 

49 

67 

90 

Effect  of 

errors- 

dependabil- 

ity and 

accuracy 

5 

15 

27 

42 

60 

Supervision 

of  others 

5 

15 

27 

42 

60 

/ 

200 
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TABLE  33  — Continued 


Factors   Degrees 


8 


Effort 

Mental  appli- 
cation or 
effort      10    15   26   49   67    90 

Physical  ap- 
plication or 
effort       5    15   27    42   60 

Job  Conditions 

Accident  or 
health 
hazards      5   15  27   42   60 


Soxirce:  Author, 

This  plan  is  designed  to  include  every  position  in 
the  hospital  with  the  exception  of  staff  physicians  and 
interns.   This  master  rating  plan  was  the  result  of  a  com- 
prehensive analysis  of  factors,  factor  weights  and  degree 
progressions  of  point  plans  submitted  by  hospitals  par- 
ticipating in  the  survey.   Factors  were  selected  vfliich 
appeeored  necessary  to  cover  adequately  all  facets  of  hos- 
pital operation.   In  addition,  factor  weights  and  point 
progressions  were  established  which  would  make  it  possible 
to  include  the  entire  range  of  hospital  jobs  in  the 
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evaluation  plan.   Such  a  plan  la  universally  applicable 
to  hospitals;  however,  each  individual  institution  should 
undertake  to  rate  key  jobs  under  the  plan  and  test  for 
validity.   Since  this  plan  has  not  been  validated  it  is 
quite  likely  that  modification  of  factor  weightings  will 
be  needed.   If  so,  such  adjustments  should  be  made,  the 
key  jobs  rerated  and  the  plan  again  siibjected  to  a  check 
on  its  validity. 

If  the  hospital  is  desirous  of  developing  its  own 
plan  for  rating,  the  first  and  foremost  problem  is  the 
selection  of  factors,  weights  and  degree  progression.   The 
question  of  v^at  and  how  many  factors  and  degrees  to  use 
should  receive  serious  consideration.   In  accordance  with 
certain  principles  relating  to  psychological  measurement, 
factors  for  evaluation  should  meet  the  following  tests: 

1«  Observable  and  found  in  all  jobs. 

2.  Exist  in  all  jobs  in  widely  varying 
amounts. 

3.  Capable  of  being  clearly  described  in 
terms  which  are  generally  landerstood. 

4.  Measurable  in  order  to  mark  differences 
between  jobs. 

5.  Independent  of  each  other. 

6*  Parsimonious,  or  the  fewest  possible 
to  accomplish  accurate  measxireroent. 


A  complete  job  evaluation  manual,  describing  in 
detail  each  factor  amd  each  degree  within  the  factor  for 
this  plan,  is  presented  in  Appendix  E. 
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The  major  Issues  relate  to  items  5  zmd  6,    namely, 
mutual  exclusiveness  of  items  and  use  of  the  fewest  factors 
consistent  with  good  practice, 

Wiat  are  the  controlling  considerations  in  factor 
selection?  First,  it  is  important  to  remember  that 
factors  selected  should  fit  the  needs  of  the  organization 
concerned  and  should  be  applicable  to  the  types  of  jobs  to 
be  evaluated.   Factors  such  as  attendance  vfliich  are  common 
to  all  jobs  to  the  same  extent  should  not  be  included. 
Likewise,  factors  such  as  opportunity  for  advancement, 
difficulty  of  locating  work  elsewhere,  existing  rate  of 
the  Job,  or  profits  o^  the  company  have  no  place  in  a  job 
evaluation  plan  since  they  cannot  help  to  indicate  the 
relative  significance  of  the  various  jobs  to  be  evaluated. 
On  the  other  hand  it  is  imperative  that  all  factors  im- 
portant to  the  jobs  to  be  measured  be  included  in  the 
system.   Otherwise,  if  a  job  requires  a  high  degree  of 
some  factor  not  included  in  the  point  scale,  that  job  can 
get  credit  only  to  the  extent  that  it  requires  the  factors 
being  utilized.   It  loses  credit  for  the  one  outstanding 
factor  which  might  have  added  value  to  it.   This  should  not, 
however,  lead  one  to  the  false  conclusion  that  more  factors 
tend  to  increase  the  accuracy  of  measurement. 
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The  factors  selected  should  be  adequately  defined. 
Since  these  definitions  must  be  of  such  a  nature  as  to 
satisfy  all  parties  concerned  as  to  meaning  and  intent, 
it  is  mandatory  that  they  be  spelled  out  in  detail  in 
order  to  hold  misinterpretations  to  a  minimum.  Under  no 
circtmstances  should  the  process  of  defining  What  is  meant 
to  be  covered  by  a  particular  factor  be  left  to  the 
individual  cinalyst.   Since  individiials  differ  with  respect 
to  previous  training  and  experience  both  of  v*iich  tend 
to  influence  their  thinking,  it  is  virtually  impossible 
to  secure  con^sarable  results  \anless  exact  meauiing  has  been 
written  into  the  definition  of  each  factor. 

The  assignment  of  relative  weights  to  each  rating 
factor  is  arbitrary;  however,  a  thorough  knowledge  of 
hospital  jobs  and  the  relative  importance  of  the  factors 
making  up  these  Jobs  will  give  a  general  idea  as  to  how 
the  factors  should  be  weighted.  Whether  or  not  the 
weights  have  been  properly  assigned  will  show  up  vftien  the 
system  is  subjected  to  the  validation  process.  If  it 
appears  that  an  error  has  been  made  in  weighting  factors, 
the  system  should  be  modified  to  meet  existing  needs. 

Once  factors  have  been  chosen  and  weighted,  it 
then  becomes  necessary  to  decide  whether  to  use  an  arithmetic 
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or  modified  geometric  progression  in  establishing  degree 
values.   Since  the  plan  should  cover  the  complete  rzmge 
of  positions  in  the  hospital,  a  modified  geometric  pro- 
gression would  be  most  satisfactory.  This  will  make  cer- 
tain that  a  sufficient  ntaraber  of  points  are  available 
adequately  to  differentiate  the  higher  eschelon  jobs. 
Of  even  more  importance,  however,  is  the  fact  that  a  geo- 
metric progression  in  degree  values  tends  to  create  a 
greater  degree  of  proportionality  between  increases  in 
wages  and  point  assignments,  ccmsequently,  the  regression 
line  tends  to  linearity  When  plotted  on  an  arithmetic 
graph.  Since  linearity  is  necessary  if  multiple  corre- 
lation is  to  be  used  as  a  means  of  determining  the  most 
satisfactory  weighting  of  factors  used  in  rating,  the  geo- 
metric progression  in  degree  values  is  justified. 

In  connection  with  the  problem  of  degree  determin- 
ation, at  least  two  interrelated  points  deserve  special 
consideration.  The  first  of  these  relates  to  the  defi- 
nition of  degrees  and  the  second  to  degree  adequacy.  All 
caution  should  be  exercised  in  defining  degrees  to  make 
certain  that  the  point  progression  eunong  degrees  does  not 


^See  the  comments  of  W.  H.  Prater,  Director,  Work 
and  Wage  Ajialysis  Section,  General  Motors  as  reported  in 
Lytle,  op.  cit.,  p.  253. 
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follow  a  geometric  patteim  \*iile  the  degree  definitions 
are  designed  to  be  arithmetically  equidistant  or  vice 
versa.   Such  a  procedure  shows  up  dramatically  In  jobs 
representing  the  top  of  the  hierarchy  and  tends  to  render 
the  results  Invalid  and,  therefore,  unacceptable. 

In  conjunction  with  the  establishment  of  degree 
definitions,  it  is  wise  to  quantify  such  definitions  as 
much  as  practical  through  the  use  of  concrete  and  objective 
terms.   The  use  of  such  ambiguous  tejnns  as  "almost," 
"poorer  them,"  "average,"  "xinusual  conditions,"  "heavy 
load,"  "some  responsibility,"  etc,  tend  to  create  confusion 
in  the  thinking  of  individual  analysts  since  they  do  not 
convey  the  same  meaning  to  different  people.  For  example, 
in  defining  degrees  for  the  factor  "physical  application," 
even  the  statement  "handles  light  weights"  may  not  be 
adequate.   In  and  of  itself  this  statement  is  subject  to 
various  Interpretations  of  vdaat  is  meant  by  a  "light" 
weight.   In  this  instance  a  quantified  measure  of  the  terra 
is  required.  To  the  extent  that  such  concrete  definitions 
can  be  used,  variations  vftiich  tend  to  reduce  inter-analyst 
reliability  will  be  eliminated. 


^Franklin  G.  Moore,  "Statistical  Problems  in  Job 
Evaluation,"  Personnel,  XXIII,  No.  2  (September,  1946), 
p.  128. 
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A  second  means  of  assisting  the  analyst  in  the 
proper  use  of  degree  definitions  is  in  giving  examples  of 
jobs  Which  have  been  deemed  to  possess  a  particular  degree 
of  the  factor  in  question.  After  each  degree  definition* 
such  jobs  are  listed.   Such  an  effective  approach  for 
purposes  of  enhancing  program  objectivity  has  been  recom- 
mended in  the  Occupational  Rating  Plan  of  the  Industrial 
Management  Society. 

The  second  facet  of  the  problem  of  degree  deter- 
mination relates  to  the  number  of  degrees  to  use.   In  con- 
structing the  point  plan,  the  nxamber  of  degrees  to  use  is 
determined  by  judgment  based  on  experience.   Belcher  indi- 
cates that  "the  nunOaer  of  degrees,  like  the  factors  them- 
selves, depends  upon  the  organization  and  the  jobs  under 
stu^.   If,  for  example,  working  conditions  are  apparently 
identical  for  most  jobs,  and  those  jobs  with  working  con- 
ditions that  differ  frcro  the  general  rule  have,  among  them- 
selves, similar  surroundings,  then  two  degrees  of  this 
factor  are  sufficient.   If,  on  the  other  hand,  seven  or 
even  more  categories  are  clearly  discernible,  that  number 
of  degrees  should  be  specified. "2 


^Occupational  Rating  Plan,  Industrial  Management 
Society,  205  West  Wacker  Drive  (Chicago,  1943)  as  quoted  in 
Otis  and  Leukart,  op.  cit.,  pp.  133-134. 

^Belcher,  op.  cit.,  p.  211. 
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Either  siibsequent  to  or  concurrently  with  selection 
of  a  rating  plan,  attention  should  be  devoted  to  developing 
an  organizational  framework  within  vghich  the  plan  is  to 
fionction.  The  following  section  deals  with  this  problem. 


Organizing  Preparatory  to  Installation  of  Formal 
Job  Evaluation  Progreun 


Define  area  of  responsibility  for  carrying  out  program 

To  attempt  to  install  and  operate  a  job  evaluation 
plan  in  the  hospital  without  strong  emd  continuing  leader- 
ship is  inviting  failure.  The  answer  lies  in  the  appoint- 
ment of  a  program  coordinator  charged  with  the  full-time 
responsibility  for  the  installation  of  the  plan  and  at 
least  part-time  responsibility  for  seeing  that  the  plan  is 
kept  up-to-date.   To  expect  the  administrator  or  the  per- 
sonnel manager  (if  one  exists)  to  accept  the  responsibility 
for  installing  and  operating  the  plan  in  addition  to  his 
regular  duties  is  to  place  the  effectiveness  of  the  plan 
in  jeopardy  —  this  despite  the  fact  that  in  those  hos- 
pitals vdiich  have  developed  job  evaluation  a  large  majority 
expect  either  the  administrator  or  personnel  manager  to 
shoulder  the  entire  responsibility.  Perhaps  this  accounts 
in  part  for  the  apparent  reluctance  of  the  hospital  to 
establish  job  evaluation  plans. 
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It  should  be  one  of  the  chief  functions  of  this 
coordinative  staff  individual  to  act  as  liaison  between 
the  department  heads,  supervisors,  personnel  department, 
the  administrative  office  and  the  local  hospital  council's 
evaluation  team.   To  establish  proper  areas  of  authority 
and  responsibility,  the  working  relationships  between  the 
coordinator,  the  personnel  department  and  the  administrator 
should  be  adequately  defined.   In  those  instemces  vAiere 
the  hospital  has  a  personnel  manager,  the  coordinator 
shoxild  report  directly  to  him.   Otherwise,  he  should  re- 
port to  the  administrator  or  his  assistant. 

The  coordinator  should  be  charged  with  the  primary 
responsibility  for  all  routine  plsmning  and   scheduling  of 
activities  prior  to  and  during  actual  installation  of 
the  program  in  order  to  relieve  the  principal  adminis- 
trators of  all  except  major  decisions  relative  to  the 
program.   This  is  not  to  suggest  that  general  knowledge 
and  information  regarding  the  job  evaluation  program 
reside  within  the  exclusive  domain  of  the  coordinator^ 
The  plan  and  its  resultant  wage  development  involve  too 
many  ramifications  for  this  to  be  allowed.  Rather  the 
intention  is  to  make  certain  that  some  responsible  indi- 
vidual assumes  responsibility  for  seeing  the  plan  through* 
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Baker  and  True,  in  their  study  of  the  operation  of 
industrial  job  eval\iation  plans,  point  out  that  "while 
findings  of  this  stu^  tend  to  confirm  the  impression 
that  inadequate  administrative  arrangements  may  be  largely 
responsible  for  failure  of  Job  evaluation  plans,  they  also 
indicate  that  management  has  begun  to  recogniz*  this  weak- 
ness auid«..have  made  eacplicit  assignment  of  responsibility 
for  administration."^ 

It  is  especially  important  that  a  prograun  coordin- 
ator be  selected  when  either  an  evaluation  group  frcwn  the 
hospital  council  or  a  consultant  has  been  asked  to  estab- 
lish and  install  a  job  evaluation  plan  in  the  hospital. 
Since  few  hospitals  retain  council  personnel  or  consultants 
to  operate  the  plan  after  its  installation,  it  is  impera- 
tive that  responsibility  be  delegated  to  someone  to  digest 
thoroughly  the  system  and  its  functioning  so  that  when 
the  program  is  turned  over  to  the  persoxmel  department, 
the  program  will  not  deteriorate  and  eventually  disintegrate. 

Develop  training  program  for  those  viho  will  operate  the  plsm 

fhe   Importance  of  a  thorough  training  in  the  funda- 
mentals of  job  evaluation  for  those  responsible  for  the 


^Baker  and  True,  op.  cit.,  p.  28, 
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creation  and  operation  of  the  plan  cannot  be  overstressed. 
Hov*ever,  in  too  many  instances,  hospitals  will  have  trained 
personnel  establish  the  program  and  then  allow  ine3Q>er- 
ienced  individuals  to  operate  it.   Such  an  approach  will 
destroy  the  entire  program.   It  is  especially  important 
that  those  who  are  to  assume  the  responsibility  for  rating 
jobs  be  trained  in  the  fundamentals  of  rating  since  the 
reliability  of  the  program  depends  to  a  large  extent  upon 
the  adequacy  of  such  training.  With  several  individuals 
rating  jobs,  unless  interrater  reliability  exists,  the 
resultant  wage  program  will  undoubtedly  contain  inequal- 
ities. Research  by  Cohen  at  Purdue  University  suggests 
that  "no  matter  Who  performs  the  job  evaluation,  as  long 
as  he  is  adequately  trained  in  the  techniques  of  the  job 
evaluation  method,  the  resultant  hierarchy  of  jobs  will  be 
Btibstantially  the  same." 

Since  the  job  evaluation  program  is  a  continuing 
one.  the  problem  of  rater  reliability  assumes  added  sig- 
nificance.  Proper  training  is  the  logical  solution  to 
achieving  the  desired  degree  of  reliability.   Hay  has  sug- 
gested the  development  of  a  set  of  "training  jobs"  as  a 
device  for  training  job  raters  and,  at  the  same  time,  to 


^Cohen,  op.  cit.,  p.  459, 
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measure  the  degree  of  skill  attained  by  each.^  Although 
Hay  is  concerned  with  the  factor  comparison  system  of 
evaltiatlon  the  same  idea  is  valid  for  training  raters  in 
the  use  of  the  point  plstn.   In  all  instances  key  jobs 
should  be  selected  for  training  purposes*   Since  these 
Jobs  are  well-known  and  are  subject  to  validity  checks  in 
the  labor  market,  it  is  more  certain  that  their  relative 
values  are  properly  stated.   If  such  a  condition  does 
not  prevail,  it  is  possible  that  raters  will  be  trained  in 
rating  jobs  v^ose  rates  are  internally  inconsistent.   This 
would  destroy  the  value  of  any  plan  to  train  raters  in 
proper  rating  procedures. 

After  considerable  practice  on  these  jobs  the 
raters  commence  work  on  non-key  jobs;  provided,  of  course, 
installation  of  the  plan  has  alrea^  been  acconplished 
and  training  is  being  tindertsiken  for  personnel  to  keep  the 
plan  up  to  date.   It  should  be  noted  here  that  reliability 
of  the  plan  may  be  just  as  effectively  destroyed  over  a 
period  of  time  as  vflien  it  is  being  installed.   If  new  raters 
are  brought  into  the  situation  vdio  will  rate  new  or  changed 


^Edward  N.  Hay,  "Training  the  Evaluation  Committee 
in  Factor  Comparison  Job  Evaluation, "  in  Dooher  and  Marquis, 
op.  cit. ,  pp.  46  2uid  49. 
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jobs  differently  from  the  original  raters,  the  system  is 
subject  to  difficulties.   Consequently,  the  best  procedure 
to  counteract  such  a  problem  is  the  establishment  and 
continuance  of  a  permanent,  experienced  rating  group. 
The  members  of  such  a  group  will,  through  constant  prac- 
tice, achieve  a  degree  of  uniformity  of  rating  vAiich  would 
othexrwise  be  impossible  of  achievement. 

Another  area  in  \Aiich  training  is  of  prime  importance 
is  that  of  analyzing  jobs  and  writing  descriptions.   The 
coordinator  must  be  adequately  trained  in  the  proper  method 
of  analyzing  jobs  and  writing  them  up  in  the  form  of  de- 
scriptions useful  for  rating  purposes.   In  some  instances 
the  coordinator  will  be  the  sole  analyst;  however,  better 
practice  is  to  have  several  individuals  trained  to  assist 
in  preparing  descriptions  and  specifications.   Such  a  pro- 
cedure assures  continuity  of  the  program. 

Reliability  and  accuracy  of  information  are  of 
paramount  importance  in  the  gathering  of  job  information 
and  the  writing  of  descriptions.   This  is  especially  true 
v^ere  several  analysts  are  employed.  A  simple  training 
device  designed  to  produce  uniformity  of  action  is  to  have 
analysts  write  descriptions  for  the  seune  jobs  and  then 
compare  notes.   Even  after  the  analysts  have  gained 
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e3cperlence  in  gathering  job  information  and  writing  de- 
scriptions, an  occasional  comparison  of  descriptions  for 
the  same  Jobs  vdll  tend  to  prcwjote  consistency  of  action. 
It  is  readily  apparent  that  the  training  procedure  con- 
stitutes cui  effective  means  of  assuring  meiximum  reliability 
of  the  hospital  job  evaluation  program. 

Develop  outline  of  program  schedule 

One  of  the  preliminary  but  foremost  activities  to 
be  accomplished  preparatory  to  installation  of  the  job 
evaluation  plan  is  the  development  and  distribution  of  the 
program  schedule.  The  basic  principles  involved  in  dis- 
seminating information  in  connection  with  the  program  tie 
in  very  closely  with  the  attitudes  of  management,  super- 
visors and  employees.  The  attitude  of  these  groups  will 
be  the  result  of  v^at  there  was  to  start  with  and  the 
effectiveness  of  the  approach  to  program  development.   It 
Is  important,  then,  that  a  detailed  explsmatlon  of  the  pro- 
gram, its  purpose,  and  steps  to  be  accomplished  be  published. 
Eacperience  has  suggested  that  the  hospital  prepare  and  dis- 
tribute a  flyer  covering  such  questions  as:   (a)  vdiat  is 
meant  by  job  evaluation,  (b)  what  are  the  steps  to  be 
accomplished  in  establishing  a  job  evaluation  program. 
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(c)  how  will  Job  evaluation  affect  the  individual,  (d) 
what  is  to  be  accomplished  with  the  job  evaluation  pro- 
gram, (e)  and  what  is  the  responsibility  of  the  individual 
in  maJcing  the  plan  work. 

In  order  that  standards,  in  terms  of  both  time 
and  accomplishment,  be  established,  ccsnpletion  datos  for 
successive  phases  of  the  program  should  be  included  in  the 
work  schedule  as  well  as  a  statement  of  final  results  ex- 
pected from  installation  of  the  evaluation  program.  Such 
a  procedure  leaves  no  one  uncertain  as  to  vdiat  is  ex- 
pected of  him.   Such  a  schedule  of  events  should  be  pre- 
pared and  distributed  at  a  group  meeting  several  weeks 
prior  to  installation  of  the  program.   Its  effectiveness 
is  lost  if  too  long  a  period  of  time  elapses  between  the 
time  informative  material  is  passed  out  and  the  program  is 
begun.  Likewise*  if  insufficient  time  is  allowed  for 
questions  about  the  program  to  be  answered  before  it  is 
installed,  universal  understanding  and   acceptamce  may  not 
be  forthcoming. 

Sell  the  program  to  depariiment  heads  auid/or  supervisors 

Once  the  work  schedule  has  been  set  up  a  carefully 
planned  program  of  enlisting  the  support  of  department  heads 
and/or  supervisors  is  inaugurated.  The  first  phase  of  the 
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Installation  is  initiated  with  the  administrator  calling 
the  depeurtnient  heads  and/or  supervisors  together  for 
piurposes  of  explaining  in  detail  the  purpose  of  the  pro- 
gram, how  it  will  be  carried  out  auid  vAiat  it  will  do  for 
them.  D.  L.  Belcher  of  the  Industrial  Extension  Service 
of  the  A.  and  M.  College  of  Texas  e3q>lains  the  idea  thus: 
"If  we  wemt  oxir  job  evaluation  program  to  be  accepted... 
we  are  going  to  have  to  do  a  complete  Job  of  selling  the 
supervisor.  He  is  going  to  have  to  want  it  badly  before 
it  is  given  to  him  and  our  job  as  management  is  to  create 
that  desire." 

It  is  important  that  such  a  meeting  not  only  be 
called  by  the  administrator  but  he  should  also  attend  the 
meeting  as  visual  evidence  of  the  acceptance  of  the  pro- 
grckm  by  top  administrative  authority.  His  presence  serves 
to  emphasize  the  importance  of  the  program.   In  an  intro- 
ductory meeting  of  this  nature  attended  by  the  writer,  the 
administrator  not  only  attended  but  opened  the  meeting  with 
some  well-chosen  remarks  concerning  the  in^ortance  of  the 
program  not  so  much  to  the  hospital  but  to  the  super- 
visors themselves.  At  this  preliminary  meeting  and  any 


^Dallas  L.  Belcher,  "Supervisory  Acceptance  of  Job 
Evaluation, "  Personnel  Journal,  XXVIII,  No.  11  (April 
1950),  p.  407. 
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subsequent  meetings^  those  In  attendance  should  he   given 
opportunity  to  as}t  any   question  they  might  have  relative 
to  amy  facet  of  the  program  or  its  possible  consequences. 
All  questions  should  be  answered  in  a  straightforward 
mamner.  Any  deliberate  withholding  of  information  might 
well  wreck  the  Whole  program.   It  is  especially  in.portant 
that  questions  regarding  the  effect  the  job  evaluation 
program  might  have  on  the  supervisors*  own  position  be 
handled  immediately.   In  this  respect  "supervisors  must 
be  convinced  that  job  evaluation  does  not  rob  them  of  their 
age-old  prerogative  of  having  a  voice  in  the  determination 
of  the  wages  of  those  v*iom  they  supervise;  that  job  eval- 
uation is  a  process  for  helping  a  supervisor;  that  instead 
of  taking  away  from  the  fvmction  of  determining  rates, 
they  are  being  given  the  benefits  of  pooled  judgment. 
They  must  be  sold  on  the  idea  that,  once  properly  set  up, 
job  evaluation  removes  most  of  the  possibility  of  charges 
against  them  of  discrimination  or  favoritism." 

Supervisors  may  be  especially  concerned  over 
possible  loss  of  tlie  right  to  assist  in  establishing  the 


P.  W,  Jones,  "Selling  the  Job  Evaluation  Progreun, ' 

National  Industrial  conference  Board,  studies  in  Personnel 
Policy,  No.  25  (September  1940),  p.  4. 
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wages  of  Individual  employees  iinder  their  Jurisdiction. 
Actually,  the  job  evaluation  plan  does  not  specify  the 
viTage  of  amy  Individual  employee.   This  is  a  function  of 
the  merit  rating  system.   The  evaluation  plan  establishes 
wage  rate  ranges  within  vrtiich  given  jobs  fall;  however, 
the  progress  of  any  given  individual  through  the  various 
merit  steps  within  the  rate  range  is  still  within  the 
Jurisdiction  of  the  supervisor.  As  a  matter  of  fact,  a 
well-developed  Job  evaluation  plan  is  an  aid  to  the  super- 
visor since  he  will  no  longer  have  to  prostitute  the  merit 
rating  system  in  order  to  attract  or  hold  employees.   The 
hospital's  wage  scale  is  now  competitive  and  the  super- 
visor is  in  a  much  better  position  to  secure  and  retain 
qualified  personnel. 

This  meeting  will  perhaps  be  the  first  real  con- 
tact with  the  prograun  the  department  heads  and/or  super- 
visors have  had.   In  the  event  supervisors  or  department 
heads  have  been  previously  contacted  for  assistance  in 
determining  v*iat  rating  factors  to  include  in  the  plan  or 
other  problems  connected  with  development  of  the  program, 
so  much  the  better.   In  this  case,  questions  will  be  more 
intelligent  since  they  are  based  on  a  certain  araoxint  of 
factual  knowledge.   Under  either  circumstance,  the  gathering 
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should  be  used  to  establish  a  meeting  of  minds  regarding 
the  evaluation  program. 

At  this  initial  meeting  the  coordinator  should 
distribute  copies  of  the  previously  prepared  vork  schedule 
to  all  department  heads  and  supervisors.  Each  item  on  the 
agenda  should  be  fully  explained  and  ccwtplete  emswers 
given  to  any  specific  questions  regarding  the  schedule. 
If  the  council's  evaluation  group  is  to  assist  in  developing 
the  program,  they  should  also  be  in  attendance  at  this 
meeting  in  order  to  answer  any   technical  questions  that 
might  be  encountered. 

Although  this  preliminary  meeting  is  intended  to 
help  "sell"  supervisors  on  the  approaching  program,  nothing 
will  achieve  such  an  objective  as  thoroughly  and  compre- 
hensively as  will  a  preplanned  program  of  participation 
on  the  part  of  supervisors.  With  respect  to  this  problem 
a  msmagement  consultant  states:   "Recent  experience  has 
shown  that  misunderstanding  and   lack  of  acceptance  need 
not  be  the  inevitable  aftermath  of  installing  a  new  Job 
evaluation  plan.  The  answer,  while  no  'cure-all',  is 
participation  —  controlled  participation  in  the  installation 
of  the  new  plan  by  those  to  be  covered  by  it,"^ 


^Harry  w.  Daniels,  "Winning  Acceptamce  for  the  Job 
Evaluation  Plan, "  Personnel,  XXX,  No,  1  (July  1953) ,  p.  31, 
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Among  the  more  important  means  of  secxiring  super- 
visojry  acceptance  through  participation  are:   giving  the 
supeirvisor  an  opportunity  to  review  and  sign  job  de- 
scriptions for  jobs  under  his  jurisdiction  before  they 
are  released  for  rating  purposes;  including  the  immediate 
superior  in  the  group  rating  jobs  in  his  department  or 
section;  and,  keeping  supexnrisors  completely  infonoed  on 
the  progress  of  the  program  at  all  stages  through  group 
meetings  or  distribution  of  printed  informational  material. 
The  benefits  to  be  derived  from  such  a  positive  approach 
to  selling  the  program  vd.ll  far  outweigh  the  costs  involved. 

Sell  the  program  to  employees 

Once  the  department  heads  and/or  supervisors  are 
clearly  in  possession  of  all  necessary  facts  and  have  con- 
vinced themselves  of  the  program's  value,  small  group 
meetings  should  be  called  for  the  purpose  of  e:q)lalning 
the  program,  its  purposes,  zmd  operation  to  all  employees. 
It  is  suggested  that  employees  be  divided  into  groups  of 
25  for  puirposes  of  keeping  the  group  small.   However,  if 
the  hospital  employs  a  relatively  few  employees,  meetings 
on  a  departmental  basis  would  be  quite  effective. 
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It  is  the  coordinator's  responsibility  to  explain 
the  plan  to  employee  groups  always  with  the  supervisor 
present.   This  gives  the  supervisor  an  opportunity  to 
hear  the  details  of  the  plan  escplained  again  as  well  as 
making  certain  that  all  within  the  department  have  the 
same  understanding  of  the  program  and  its  operation.  A 
representative  of  the  hospital  council's  evaluation  group 
should  also  be  present  at  these  departmental  meetings  to 
handle  any  technical  details  that  might  arise,   if  the 
coordinator  has  been  properly  trained,  he  should  be  able 
to  explain  the  plem  to  employees  with  a  minimum  of  assist- 
ance from  the  evaluation  group  representative.  Where 
possible,  departmental  supervisors  may  be  given  opportunity 
to  e3Q>lain  the  workings  of  the  program  to  their  subordinates 
always  with  the  coordinator  and/or  evaluation  group  repre- 
sentatte  in  attendance.   Such  a  procedure  necessitates  the 
supervisor  being  thoroughly  acquainted  with  the  details  of 
the  plan  and  leads  to  a  better  vmderstanding  emd  acceptance 
on  his  part. 

As  for  p>ersonnel  in  the  higher  eschelons,  all  em- 
ployee questions  should  be  adeqviately  and  straightforwardly 
answered.  All  of  the  possible  difficulties  that  might  accrue 
on  the  supervisory  level  as  a  result  of  ignoreince  of  or 
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ml siinder standing  about  the  plan   and  its  purposes  apply 
with  ec[ual  force  to  hospital  employees  below  the  super- 
visory level. 

One  question  vihich  ineviteO^ly  comes  up  has  to  do 
with  salaries  %i^ich  might  be  £otind  to  be  above  the  ulti- 
mately developed  wage  structure  --  the  so-called  "red 
circle"  Jobs.  In  all  cases,  and  with  no  exceptions, 
assurance  should  be  given  that  "out-of-line"  rates  will 
not  result  in  pay  reductions  or  loss  of  benefits  to  any 
employee.   This  point  is  imperative  for  if  employees 
feel,  rightly  or  wrongly,  that  job  evaluation  constitutes 
a  meems  for  the  administration  to  cut  salaries,  the  pro- 
gram immediately  becomes  a  lost  cause  and  very  little  will 
be  acc(»iiplished.   "The  consequent  loss  of  employee  morale 
will  far  outweigh  any   possible  advantage  that  might  be  ex- 
pected to  accrue  frcmi  the  program.  Whatever  the  cost, 
these  out-of-line  rates  must  be  maintained  at  the  same 
level  as  before  the  introduction  of  the  evaluation  program. 
True,  such  a  step  will  further  increase  the  total  wage  bill 
even  above  the  adjustment  necessary  to  bring  underpaid  Jobs 
into  line.  However,  this  is  a  temporary  condition  which 
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may  be  rectified  When  noxrmal  attrition  or  promotion 
vacates  these  red  circle  Jobs.  At  such  time,  the  rates 
for  these  Jobs  may  be  adjusted  dovmwiurd  to  their  appro- 
priate relative  position  in  the  Job  hierarchy.  Whatever 
the  administrator's  feeling  tovrard  such  a  procedure  might 
be,  there  is  no  tolerable  alternative.   Eit^loyees  must  be 
informed,  among  other  things,  that  the  Job  evaluation 
program  is  not  a  panacea  for  all  wage  ills;  that  this  type 
of  wage  correction  is  one  of  the  few  remaining  possibilities 
for  removing  irregularities  from  the  wage  structure;  that 
individual  differences  will  be  taken  care  of  through  merit 
increases  within  the  rate  remge  established  by  Job  eval- 
uation; that  they  will  be  kept  informed  of  the  progress 
of  the  program;  that  they  will  be  able  to  participate  in 
the  program  either  directly  or  through  their  representa- 
tives; that  vAiile  the  organization  regards  all  employees  as 
having  individualities,  for  purposes  of  Job  evaluation  it 
is  only  the  Job  that  counts;  and  that  the  resulting  pro- 
gram will  be  something  that  everyone  can  imderstand. 

Implementing  the  Program  of  Job  Evaluation 
Develop  job  analysis 
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Once  the  importcuit  Job  of  selling  the  program  Is 
accomplished  and  it  is  appeirent  that  an  xinder standing  is 
had  by  all  concerned,  the  actiial  process  of  gathering  job 
data  should  begin*  Such  an  analysis  of  the  jobs  is  f\inda- 
mental  to  a  proper  evaluation  procedure.  According  to 
Benget  "Any  plein  of  job  evalxiation  vftiich  calls  itself 
scientific  must  rest  upon  adequate  job  analysis." 

The  Job  analysis  should  constitute  the  foundation 
upon  \*hich  the  hospital's  personnel  prograun  is  to  be 
built.  There  are  few,  if  amy,  phases  of  the  personnel 
program  v*iich  cannot  benefit  either  directly  or  indirectly 
from  a  good  Job  analysis  and  the  resultant  descriptions 
and  specifications.  Consequently,  even  though  the  Job 
analysis  may  have  been  initiated  as  a  result  of  an  admin- 
istrative decision  to  install  a  job  evaluation  program,  it 
should  be  recognized  as  the  key  to  developing  a  long 
range  personnel  progrsun. 

Job  analysis  is  all  important  in  the  effective 
development  of  training  programs,  recruitment,  selection 
and  placement  of  employees,  safety  programs,  wage  and 
salary  administration  amd  a  host  of  other  frinctions.  For 
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example «  the  analyst,  in  making  a  thorough  and  detailed 
study  of  the  duties,  responsibilities  and  minimiim  require- 
ments necessary  to  hemdlc  a  given  job,  automatically  se- 
cures information  important  to  the  training  officer.  From 
this  information  a  plan  may  be  dravn  up  for  training 
individuals  to  effectively  measure  up  to  the  requirements 
of  this  particulsr  job.  Again,  it  is  difficult  for  the 
placement  director  to  recruit  qualified  personnel  without 
an  adequate  knowledge  of  job  requirements.   Such  infor- 
mation is  available  only  if  a  thorough  analysis  of  Jobs 
has  been  undertaken  and  the  resultemt  descriptions  and 
specifications  made  available  to  personnel.  This  is  es- 
pecially important  in  a  large  hospital  with  a  great  diver- 
sity of  jobs.  No  personnel  manager  cam  know  enough  about 
each  different  job  to  recruit  effectively  without  the  aid 
of  written  descriptions  secured  from  the  Job  analysis. 
The  same  extensive  job  information  is  necessary  in  the 
effective  selection  and  placement  of  employees.  Those  re- 
sponsible for  the  development  of  safety  programs  must  first 
know  vAiat  dangers  are  inherent  in  the  demands  of  the  jobs. 
The  question  of  whether  the  job  contains  activities  \^ich 
require  safety  precautions  or  \^ether  the  job  requires 
operation  of  a  dangerous  machine  can  be  effectively  answered 
only  from  an  adequate  analysis  of  the  job.   In  view  of  the 
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degree  of  importance  attached  to  the  job  analysis «  attention 
should  be  given  to  securing  all  necessary  information  at 
one  time.  Failure  to  secure  information  important  to 
any  one  of  the  above  activities  requires  that  the  analysis 
be  undertaken  a  second  time.   Such  unnecessary  costs  in 
tlme«  effort  and  money  can  readily  be  avoided. 

In  order  to  make  certain  that  information  gathered 
is  ccRaplete,  trained  analysts  should  be  placed  in  charge 
of  the  activity.  Initially,  the  hospital  council's  eval- 
uation group  will  assume  the  task  of  gathering  job  infor- 
mation. However,  the  coordinator  should  work  with  these 
analysts  in  order  to  thoroughly  acquaint  himself  with  the 
procedures.  Such  a  practice  will  enable  the  coordinator 
to  assume  responsibility  for  future  job  analysis  in  the 
hospital.   In  addition,  since  a  permanent  corps  of  amalysts 
is  mandatory  in  the  effective  functioning  of  a  continuing 
program,  the  coordinator  will  be  in  a  position  to  train 
individuals  to  effectively  handle  this  job. 

It  should  be  mentioned  here  that  it  is  not  necessary 
that  every  position  in  the  hospital  be  analyzed.  All  jobs, 
of  course,  should  be  included;  however,  vSiere  it  is  evident 
that  a  number  of  like  positions  exist,  it  is  necessary 
only  that  two  or  three  employees  from  these  positions  be 
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interviewed.  For  example,  there  may  be  ten  or  fifteen 
girls  in  the  hospital  whose  primary  duty  is  typing,  not- 
withstanding the  title  they  may  have  or  the  department 
in  which  they  might  work.   If  these  positions  are  identi- 
cal, a  description  written  from  interviewing  several 
typists  would  constitute  a  single  job.  Care  should  be 
exercised  in  making  certeiin  that  positions  which  are 
thought  to  be  alike  should,  in  fact,  be  exactly  alike, 
otherwise  some  jobs  will  be  omitted  from  the  stu^. 

At  this  point  an  activity  analysis  sheet  should 
be  prepared  for  distribution  to  d.1  hospital  employees 
whose  jobs  are  being  analyzed,  llie  activity  analysis  sheet 
should  contain  adequate  instructions  to  supplement  the 
information  given  vdien  the  sheet  is  passed  out.   It 
should  contain  sufficient  space  for  inclusion  of  all  normal 
daily  activities  plus  those  activities  undertaken  only 
occasionally.   Since  the  description  obtained  from  the 
activity  analysis  sheet  is  to  be  used  in  conjunction  with 
personal  observation  and  questioning  of  the  employee  and 
supervisor  concerned,  in  rating  jobs,  a  supplementary 
section  should  be  added  to  the  sheet  requesting  information 
on  specifications  of  the  job  in  question  (i.e.,  minimum 
necessary  education,  experience,  physical  demands  or 
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machines  operated,  etc.  In  hcuidllng  the  Job) .   It  is 
necessary  that  the  job  specifications  include  only  mini- 
mum requirements  since  the  Job  rating  will  be  based  on 
these  specifications.   For  exsunple,  i£  for  a  given  Job 
the  specification  for  education  is  stated  in  other  than 
minimum  requirements,  the  job  in  questicm  will  receive  a 
rating  on  this  cranpensable  factor  which  is  higher  them 
that  actually  required  for  the  job.  As  a  result,  the  job 
may  be  oveirvalued  in  relation  to  other  jobs.   Fuarthermore, 
\^en  such  specifications  are  being  used  in  recruiting  and 
selection,  the  listing  of  requirements  in  education,  ex- 
perience, etc.  \^ich  are  higher  than  necessary  to  adequately 
handle  the  job  may  result  in  a  restriction  of  the  number 
of  personnel  available  forhiring. 

The  distribution  of  the  activity  analysis  sheet 
should  be  made  by  the  coordinator  through  the  immediate 
supervisor  who  should  be  prepared  to  emswer  any  questions 
employees  might  have  regarding  its  completion.   Care  should 
be  exercised  in  specifying  a  completion  date,  usvially  ten 
days,  at  \^ich  time  the  sheets  will  be  collected  by  the 
supervisor.  Also,  caution  should  be  exercised  in  making 
it  very  clear  to  employees  that  it  is  the  Job  which  is 
being  studied  amd  not  the  person  filling  the  job.  A  clear 


205 
differentiation  should  be  made  between  the  value  of  the 
Job  and  the  value  of  the  man  on  the  Job,   The  supervisor 
should  check  the  sheet  for  accuracy  of  reporting  duties, 
discuss  any  possible  changes  with  the  employee  concerned 
and  then  submit  the  data  to  the  analysts. 

In  addition  to  the  questionnaire,  prior  to  the 
finished  Job  description,  the  Job  analysts  should  also 
visit  the  workplace  and  make  arrangements  for  a  private 
interview  with  the  employee.   It  has  been  the  experience 
of  the  writer  that  the  private  interview  gives  the  individual 
employee  a  chance  to  speak  his  mind  —  acting  as  a  mental 
cathartic  —  v^ile  a  visit  to  the  workplace  gives  the 
analyst  a  better  insight  into  the  job  with  any  iinusual  re- 
quirements it  may  have.  An  early  pioneer  in  Job  eval- 
uation suggests:   "Go  to  the  best  possible  source  of  in- 
formation, that  is,  the  employee  and  the  immediate  super- 
visor, interviewing  the  employee  on  the  Job  at  his  work- 
place. ..  .Questionnaires  may  be  used  if  desired,  but  not  as 
substitutes  for  the  workplace  interview."^ 

Based  on  Job  duties  described  by  employees  in  the 
activity  analysis  sheet,  in  conjunction  with  a  visit  to  the 
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workplace  by  the  analysts,  jobs  with  like  content  are 
grouped  and  assigned  tentative  job  titles.  For  example, 
a  general  typist  is  a  typist  regardless  of  v^at  department 
she  might  be  assigned  to.   Titles  of  \inique  jobs  may  be 
either  retained  or  adjusted;  however,  it  is  of  major  im- 
portsmce  that  the  nurnber  of  job  titles  and  classifications 
be  held  to  a  minimum.  The  resits  of  excessive  elaboration 
of  the  job  structure  are  many  and  \mf ortunate .  At  this 
point,  preliminary  to  the  development  of  the  finished  de- 
scriptions, the  analysts  should  make  it  a  point  to  see 
that  any  necessary  rearrangement,  elimination  or  combination 
of  individual  job  duties  or  responsibilities  is  undertaken. 
In  some  instances  it  will  be  found  advisable  to  eliminate 
entire  jobs,  to  create  new  jobs  or  to  combine  several  func- 
tions.  If  these  chsmges  are  not  made  before  descriptions 
are  finalized,  the  resultant  descriptions  are  outdated  even 
before  they  have  been  put  to  use.  Equally  important  is  the 
fact  that  if  changes  are  made  after  jobs  have  been  rated, 
the  ratings  no  longer  adequately  portray  the  correct 
relative  value  of  jobs.  Under  such  circximstances,  and  par- 
ticularly if  such  changes  have  been  substantial,  the  whole 
evaluation  plein  may  be  rendered  useless.  Hospital  admin- 
istrative experience  suggests  that  the  manual  Job  Descriptions 
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and  Occupational  Analysis  for  Hospitals  and  Related  Health 
Services  be  followed  as  a  basic  guide  for  job  nomenclature. 
Not  only  will  this  procedure  be  helpful  in  establishing 
job  titles,  it  would,  if  widely  practiced,  materially  assist 
in  vindertaking  valid  inter-hospital  wage  surveys  since  like 
jobs  would  possess  like  titles. 

Once  the  rough  job  data  are  in  hand  and  job  titles 
are  assigned,  all  jobs  are  grouped  first  by  department  and 
then  by  occupation  or  function.  Such  a  procedure  assists 
in  determining  the  number  and  types  of  skill  levels.   It 
is  iraportemt  that  all  skill  levels  be  established.  For  ex- 
ample, in  the  dietary  department  there  may  be  several  em- 
ployees performing  the  duties  of  a  cook,  A  review  of 
questionnaires  and  further  analysis  by  talking  to  the 
dietician  as  well  as  the  employees  concerned  may  indicate 
that  two  skill  levels  exist  for  the  job  of  cook  —  cook  and 
assistauit  cook.  Dietary  personnel  may  describe  the  two 
jobs  as  first  cook  (dinner  meal)  and  second  cook  (supper 
meal  and  baking) ,   Such  facts  should  be  determined  by  a 
thorough  analysis  of  the  situation.  Where  the  questionnaire 
lacks  clarity  or  where  the  supervisor  is  not  sufficiently 
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acquainted  with  details  of  the  job,  a  discussion  with  the 
employees  in  the  presence  of  the  supervisor  should  help 
to  determine  actual  job  duties  for  subsequent  rating  pur- 
poses. 

From  the  information  now  at  hand,  an  organization 
chart  should  be  constructed  for  each  department.   Such  a 
deterroination  of  relative  departmental  skill  levels  mater- 
ially aids  in  establishing  not  only  a  picture  of  structural 
relationships  but  also  relative  intra-departmental  job 
Importance.  A  more  complete  picture  of  the  skill  require- 
ments of  the  job  is  a  natural  result.   If  it  has  not  pre- 
viously been  accomplished,  the  departmental  organization 
charts  should  be  combined  to  create  a  composite  organiza- 
tional charting  of  jobs.   Such  a  chart  should  be  made 
available  to  all  department  heads  and/or  supervisors  so 
that  a  better  picture  of  hospital  orgauiizational  respon- 
sibility and   accountability  is  obtained.  The  coordinator 
should  work  very  closely  with  the  council's  evaluation 
group  (the  analysts)  in  each  of  the  aforementioned  activities. 

Develop  job  descriptions  and  specifications 

A  thorough  knowledge  of  work  requirements  is  the 
very  foundation  of  a  satisfactory  wage  program.   "Phis 
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knowledge  should  be  made  a  matter  of  common  understanding 
through  written  descriptions  and  job  specifications 
available  to  all  persons  responsible  for  the  application 
of  wage  scales  or  associated  with  the  performance  of  the 
work  itself.   The  job  analysis  normally  includes  identifying 
data  along  with  job  content  and  scope.   On  the  other  hand, 
the  job  specification  is  principally  concerned  with  minimum 
job  requirements  and  worker  qualifications.  Actually,  job 
specifications  are  often  considered  to  be  an  inherent  part 
of  the  job  description.   In  actuality,  the  description  may 
or  may  not  include  job  specifications.   In  job  evaluation, 
of  course,  the  job  specification  is  required!  however,  as 
explained  above  the  information  contained  in  the  specifi- 
cation is  quite  different  frcm  that  in  the  description 
proper. 

Since  the  job  description  must  be  fundamentally 
correct,  the  analysts  should  write  the  descriptions  from 
the  employee  activity  analysis  sheets  collected  from  the 
supervisors,  plus  information  obtained  in  personally  inter- 
viewing individual  supervisors  as  well  as  en^loyees  at  the 
work  station.   The  analysts  should  check  the  descriptions 
and  specifications  very  carefully  with  the  supervisor  to 
see  that  they  describe  the  difference  between  Jobs  in  order 
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to  see  that  the  same  terms  have  the  same  meanings  in  all 
Job  narrations  pointing  out  these  differences.   If  there 
is  more  than  one  skill  level  or  degree  of  responsibility 
between  jobs  in  em  occupation,  standardization  of  descriptive 
adjectives  is  necessary.  For  example,  a  hospital  Clerk  II 
may  need  a  thorough  knowledge  of  clerical  procedtires  re- 
quiring a  minimxam  of  two  years  clerical  experience,  vihere- 
as  the  skill  level  of  the  beginning  job  hospital  Clerk  I 
may  require  only  some  knowledge  of  clerical  procedures  in- 
cluding typing  and  filing  and  six  months  or  less  of  clerical 
experience.  The  niuiiber  of  years  experience  required  for 
each  job  should  be  related  to  this  difference  in  degree  of 
knowledge  or  skill  required.   The  same  descriptive  adjectives 
can  be  used  in  other  occupations  to  show  differences  in 
jobs  and  skill.  An  excellent  example  from  the  United  States 
Department  of  Labor  Manual  relating  to  hospital  jobs 
states  that  "a  head  nxirse,  operating  room,  administers  and 
supervises  the  nursing  service  of  a  single  operating  room 
\xntt   while  the  staff  nurse,  operating  room,  observes  aseptic 
techniques  in  preparing  for  and  assisting  with  surgical 
procedures. "^  As  another  means  of  making  the  description 


^United  States  Department  of  Labor,  Bureau  of  Em- 
ployment Seciarity,  Job  Descriptions  and  Occupational 
Analysis  for  Hospitals  and  Related  Health  Services,  op.  cit.. 
pp.  332  and  350. 
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more  explicit,  the  analysts  should  consistently  begin 
sentences  in  the  body  of  the  description  with  active  verbs 
such  as  administers,  performs,  uses,  operates,  etc.  Words 
with  quamtitative  meanings  should  be  used.  For  a  main- 
tenance repairman  it  is  more  meziningful  smd  complete  to 
write  'repairs  steam,  water,  electrical  and  gas  lines*  than 
to  indicate  'repairs  utilities* ,  Facts  should  be  used  in- 
stead of  generalizations  or  broad  detinitions. 

Upon  completion  of  the  final  drafts,  in  order  to 
maintain  their  cooperation  and   acceptance  of  the  program, 
supervisors  should  be  given  an  opportunity  to  review  the 
finished  descriptions  amd  should  be  required  to  submit 
written  approval  before  final  descriptions  are  considered 
official.  And,  finally,  individual  employees  should  also 
be  given  an  opportunity  to  check  the  final  description  of 
their  job.   This  may  constitute  a  perfunctory  action;  how- 
ever, the  importance  of  gaining  employee  acceptamce  through 
participation  will  more  than  offset  the  effort  and  time 
Involved.  Every  employee's  statement  should  be  treated  with 
respect  no  matter  how  erroneous  it  might  be.   In  such  in- 
stances friendly  discussions  should  be  held  with  the  employee 
to  reconcile  differences  of  opinion. 


212 

Select  and  evaluate  key  jobs 

The  next  phase  of  the  job  evaluation,  the  selection 
and  rating  of  "key"  or  "bench-mark"  jobs,  is  a  most  crucial 
one.   In  effect,  the  worth  of  the  \^ole  system  cf  evaluation 
is  dependent  upon  the  effectiveness  with  which  the  system 
being  installed  can  validly  rate  key  jobs.   The  commxinity 
wage  rates  of  these  key  jobs  represent  the  criteria  or 
"measuring  rod"  against  vAiich  the  independently  determined 
point  totals  for  these  saiae   key  jobs  within  the  hospital 
are  compared.   It  is  evident  that  the  content  of  the  key 
jobs  must  be  essentially  the  same,  both  for  jobs  within 
the  hospital  and  for  jobs  in  the  community  from  vdiich  wage 
infomnation  is  secured.  Otherwise,  the  criteria  them- 
selves will  be  neither  reliable  nor  valid.   Svooner  Charm 
concludes  that  "if  an  objective  is  a  factual  evaluation  of 
a  job,  the  title  is  of  little  consequence.   It's  the  com- 
ponents of  the  job  itself  that  count."   In  order  to  make 
reasonably  certain  that  job  content  is  the  same,  complete 
descriptions  of  each  key  job  should  be  used  in  the  salary 
survey.  Furthermore,  to  make  absolutely  certain  that  job 


^Sumner  D.  Charm,  Wacye  Policy  For  Management  (New 
York:  Funk  smd  Wagnalls  Co.,  1949),  p.  66. 
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content  Is  equivalent,  better  practice  dictates  that  a 
personal  interview  be  used  to  assess  the  ccxnparability  of 
key  jobs  to  be  used. 

For  purposes  of  gathering  wage  information,  caution 
should  be  exercised  in  selecting  only  Icey  jobs.  Wage  in- 
formation gathered  on  non-key  jobs  is  worthless  for  pur- 
poses of  job  evaluation.  As  a  matter  of  fact,  it  is  probable 
that  the  use  of  such  information  will  create  problems  equal 
to  or  greater  them  those  existing  without  a  job  evaluation 
program.   Under  no  circumstances  could  such  wage  information 
be  used  in  validation  of  the  plzm  of  evaluation. 

Key  jobs,  for  purposes  of  Job  evaluation,  are  Jobs 
which  possess  singular  characteristics  rendering  them  val- 
uable as  reference  points  in  valuing  tincheckable  or  unique 
jobs  through  a  process  of  validation.  They  do  not  refer  to 
jobs  in  the  hospital  v*iich  are  absolutely  essential  to  its 
operation.  All  jobs  in  the  hospital  should  meet  this 
latter  qualification.  In  choosing  key  jobs,  the  following 
requirements  should  be  met: 

(a)  The  job  in  question  should  be  such  that 
a  surplus  or  shortage  of  qualified  per- 
sonnel does  not  exist. 

(b)  For  the  job  in  question,  the  relative 
wage  rates  should  be  essentially  con- 
stant over  a  period  of  time. 
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(c)  The  Job  In  question  should  be  reasonably 
easy  to  identify  in  writing  and  be  well- 
knovm  to  those  in  the  hospital  field  or, 
in  the  case  of  administrative  or  service 
Jobs,  well-known  to  local  businessmen. 

(d)  For  the  Job  in  question  there  should  be 
a  reasonaJsly  large  niirober  of  such  Jobs 
in  the  labor  market  so  that  the  average 
wage  will  represent  a  true  average. 

(e)  As  far  as  possible  key  jobs  representing 
low,  medivmi  and  high  paid  positions 
should  be  selected  from  various  levels 
of  Job  difficulty  in  the  hospital. 

(f)  For  the  Job  in  question  the  Job  content 
should  have  remained  relatively  unchanged 
over  a  period  of  time. 

Although  each  of  these  characteristics  is  important 
in  selecting  key  Jobs,  the  first  two  represent  the  real 
basis  for  validation  of  the  plan  of  evaluation.   If,  for 
example,  the  mistake  is  made  of  selecting  as  a  key  Job  one 
%^ich  is  in  under-  or  over- supply  in  the  labor  market  in 
question,  the  resulting  wage  rate  cannot  truly  represent  the 
relative  value  of  that  Job  to  other  jobs  over  a  period  of 
time.  For  this  reason,  it  is  wise  to  determine  vAiether 
the  relative  wage  rates  of  each  key  job  have  remained  con- 
stant over  a  period  of  time.   The  following  hypothetical 
data  will  serve  to  illustrate  this  points 
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TABLE  34 

HYPOTHETICAL  KEY  JOB  RATES  SHOWING  REIATIVE 
CONSTANCY  OVER  TIME 


Job 


Messenger 
Clerk,  Jr. 
Typist,  Sr. 
Stenograph,  Sr. 
Secretary-Steno 
Secretary 


Totals 


1959 


$   42 

48 
50 
55 
57 
65 


%   of 
Total 


13.2% 

15.1 

15.8 

17.4 

18.0 

20.5 


1960 


$317 


100.0% 


46 
52 
54 
59 
63 
68 


%   of 
Total 


L 


$342 


13.4% 

15.2 

15.7 

17.3 

18.4 

20.0 


1961 


100.0% 


49 
53 
57 
62 
66 
73 


%  of 
Total 


13.6% 

14.7 

15.9 

17.2 

18.3 

20.3 


$360 


100.0% 


Source*  Author. 
Assuming  each  of  these  jobs  to  be  Tcey  jobs,  it  will  be 

seen  that  each  job  tends  to  maintain  a  relatively  constant 
position  over  a  period  of  time  with  respect  to  the  other 
Jobs.   The  time  period  may  vary  from  three  to  five  years. 
Furthermore,  since  it  is  logical  to  conclude  that  any  in- 
flationary trend  will  affect  all  jobs  over  a  period  of  time 
such  a  condition  will  have  little  or  no  effect  on  the  rela- 
tive position  of  each  job.   Such  a  procedure  would  eliminate 
the  use  of  jobs  in  the  validation  process  which  do  not  ex- 
press a  true  relative  value  to  other  jobs. 

With  respect  to  requisite  (e) ,  above,  for  key  jobs, 
the  purpose  in  selecting  key  jobs  from  various  levels  in  the 
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organizational  hierarchy  is  to  make  possible  a  more  ef- 
fective interpolation  of  iinique  jobs  with  key  Jobs.  No 
attempt  is  made  to  compare  ixnique  and  key  jobs  in  terms  of 
actual  job  content,  only  in  terms  of  difficulty  level. 
For  example,  assume  that  a  key  job  (say  a  dishwasher)  is 
rated  at  110  points  and   a  glove  girl  (a  job  unique  to  the 
hospital)  is  rated  at  70  points  and  it  is  obvious  that  the 
two  jobs  are  on  the  same  difficulty  level.   The  rater 
immediately  questions  the  rating  of  the  glove  girl's  job 
since  an  underrating  may  have  taken  place.   In  this  manner, 
key  jobs  selected  from  various  difficulty  levels  serve  as 
bench  marks  for  more  effective  interpolation  of  unique 
hospital  jobs  in  the  rating  process. 

Keeping  in  mind  the  essential  prerequisites  for  a 
key  job,  the  analysts,  with  the  assistance  and  approval 
of  administrative  authorities  should  select  frcro  10  to  30 
such  jobs  representative  of  the  entire  reuige  of  jobs  to  be 
included  in  the  evaluation  plan.   In  the  opinion  of  one 
authority  "although  the  number  of  jobs  included  in  labor 
market  survey  ranges  enormously  in  practice  frc»n  10  to  15 
up  to  as  many  as  400... there  is  good  reason  to  believe  that 
merely  increasing  the  number  of  jobs  surveyed  has  little 
bearing  on  the  reliability  of  results  obtained.  A  sur- 
prisingly small  number  of  carefully  selected  jobs  cam  be 
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made  to  produce  sovmd  results... It  is  felt  that  betveen  20 
and  30  well-chosen  jobs  will  provide  the  base  for  a  worlc- 
manlike  and  reliable  labor  market  survey."    It  is  suggested 
that  approximately  ten  per  cent  of  all  jobs  to  be  covered 
by  the  plam  be  selected  as  key  Jobs.   In  actuality,  the 
precise  number  of  key  jobs  to  use  is  a  matter  of  Judgment, 
provided,  of  course,  they  are  sufficient  in  number  to  repre- 
sent all  types  of  jobs  that  will  be  included  in  the  rating 
plan. 

Key  jobs  to  be  used  in  the  Job  evaluation  plan  will 
vary  from  one  location  to  2mother.   If  the  hospital  is 
located  in  a  labor  market  where  secretaries  are  scarce,  this 
Job  would  not  be  used.   If,  on  the  other  hand,  a  normal 
supply-demand  situation  existed  for  secretaries,  the  Job 
might  well  be  used  as  a  key  job  since  it  meets  the  other 
criteria  for  key  jobs. 

A  list  of  key  Jobs  that  might  be  considered  for  use 
in  the  hospital  would  include x 

1.  Personnel  Director 

2.  Chief  Dietitian 

3.  Superintendent  of  Buildings  and  Grounds 


^Richard  C.  Smyth  and  Matthew  J.  Murphy,  Job  Eval- 
uation and  Employee  Ratine^  (New  Yorkx  McGraw-Hill  Book 
Company,  Inc.,  1946)  pp.  98-99. 
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4*     Laimdry  Manager 

5.  Pharmacist 

6.  General  Duty  Nurse 

7.  Head  Cook 
8*  Plumber 

9.  PBX  Operator 

10.  Secreteuy  (office) 

11.  Bookkeeping  Machine  Operator 

12.  Clerk-typist 

13.  Flat-Work  Ironer 

14 .  Di  shva sher 

15.  Kaid 

In  most  instances  sufficient  wage  information  on 
these  jobs  is  available  in  the  local  labor  market.  Pujrther- 
more,  they  represent  essentially  the  entire  range  of  Jobs 
in  the  hospital.  Use  of  such  a  wide  range  of  jobs  creates 
a  better  frame  of  reference  for  interpolation  of  iinique  jobs. 
Again,  caution  should  be  exercised  in  determining  whether 
the  wage  rate  for  any  of  these  jobs  is  unduly  affected  by 
cm  over-  or  tinder- supply.   If  so,  it  should  be  left  out 
altogether  or  another  key  job  substituted. 

Once  the  key  jobs  have  been  selected,  a  rating  com- 
mittee, established  by  the  coordinator,  proceeds  to  rate 
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such  Jobs.  The  committee  should  be  composed  of  the  co- 
ordinator, a  representative (s)  of  the  council's  evaluation 
group  and  the  iimnediate  supervisor  of  each  group  whose  jobs 
are  being  rated.   In  some  instances  the  personnel  memager 
may  be  a  member  of  the  committee.  However,  better  practice 
dictates  that  a  restricted  number  of  raters  be  involved. 
It  is  especially  important  that  the  immediate  supervisor 
be  included  in  the  rating  process.   In  the  first  place,  he 
has  a  better  xinder standing  than  anyone   else  of  the  Jobs 
under  his  Jurisdiction.  This  leads  to  more  valid  Job  rat- 
ings.  Secondly,  giving  the  superior  an  opportunity  to  par- 
ticipate in  the  rating  process  involves  him  in  the  program 
and   makes  it  easier  to  sell  him  on  its  value.  This  leads 
to  a  better  overall  program  through  enlisting  the  cooperation 
of  those  v^o  will  ultimately  be  responsible  for  the  ef- 
fective fvinctioning  of  the  plan. 

Validate  the  plan  in  use 

The  next  phase  in  the  development  of  the  hospital 
Job  evaluation  plan  is  a  most  critical  one.   if  the  plan  is 
not  validated  there  is  no  proof  that  it  is  capable  of 
accurately  predicting  the  relative  value  of  uncheckable, 
unique  jobs.   Under  such  a  condition,  the  program  becomes 
completely  subjective  in  trying  to  price  Jobs. 
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Before  the  actual  validation  procedure  may  be 
carried  out,  wage  information  for  each  key  Job  must  be 
sectired  from  the  labor  market  in  question.  A  sufficient 
nixmber  of  wage  rates  should  be  secured  for  each  key  job 
so  that  weighted  averages,  representing  the  going  rates 
for  individual  key  jobs,  may  be  determined.  As  previously 
stressed,  the  content  of  key  j6bs  on  vAiich  market  wage  in*> 
foirmation  is  being  sought  must  be  the  same  as  the  content 
of  the  same  key  jobs  in  the  hospital.   In  order  to  make 
certain  that  this  condition  is  met,  personal  interviews 
should  be  made  in  securing  necessary  wage  information. 
Only  in  this  way  cem  one  be  certain  that  job  content  is 
reasonably  the  same.   This  condition  is  important  because 
the  market  determined  wage  rates  for  these  key  jobs  are  to 
be  used  as  the  external  criteria  in  validating  the  hos- 
pital* s  point  plan  of  rating.   In  addition  the  wage  rates 
for  these  key  jobs  reflect  the  inherent  demands  of  the  mar- 
ket. Consequently,  use  of  key  job  wage  rates  in  establish- 
ing the  wage  curve  automatically  gives  the  proper  relation- 
ship between  hospital  wage  rates  and  external  going  wage 
rates. 

Since  key  job  wage  rates  are  taken  from  a  relatively 
large  sample  within  a  given  labor  market,  and  unique 
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circumstances  of  particular  organizations  have  canceled 
each  other,  the  residue  (the  constant  ratios)  represent  the 
objective  judgment  of  the  labor  market  as  to  the  relative 
worth  of  jobs.  For  example.  If  the  market  prices  a  secre- 
tary's job  at  $60  and  a  clerk  typist's  job  at  $40,  it  can 
be  assumed  that  the  relative  values  of  these  Jobs  are 
accurate.  This  Is  true,  of  course.  If  these  relative  values 
have  remained  constant  over  a  period  of  time.   If  an  Inde- 
pendent rating  of  the  same  jobs  In  the  hospital  produces 
point  totals  \^lch  express  the  same  relative  values  of  the 
two  jobs  (and  If  the  same  type  of  analysis  produces  the 
same  results  for  the  remaining  key  jobs)  It  Is  apparent 
that  the  rating  plan  Is  a  valid  one.  Through  the  use  of 
correlation  amalysls  a  validity  coefficient  can  be  deter- 
mined which  expresses.  In  a  quantitative  manner,  the  degree 
of  relationship  between  the  external  wage  rates  for  key 
jobs  and  the  Internal  point  ratings  for  the  same  jobs. 
If  the  rating  of  key  jobs  has  proven  accurate 
(valid) ,  the  logical  conclusion  Is  that,  using  the  same 
rating  technique,  unique  or  uncheckeible  jobs  may  be  rated 
with  equal  accuracy.   In  the  event  the  rating  plan  as  It 
exists  proves  to  be  Invalid,  It  Is  then  necessary  to  modify 
the  factor  weights.   Since  the  use  of  a  geometric  pattern 
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of  degree  values  tends  to  produce  linearity  in  the  re- 
gression (vmge)  line,  multiple  correlation  may  then  be 
used  to  determine  the  optimum  vieights  to  assign  to  factors. 
After  modification  of  factor  weights,  the  key  Jobs  should 
be  rerated  and  again  tested  for  validity* 

Rate  unique  or  uncheckable  jobs 

Once  a  valid  rating  plan  has  been  established,  the 
rating  committee  proceeds  to  rate  the  remainder  of  the  jobs 
in  the  hospital.   If  the  same  care  is  taken  in  rating  the 
unique  jobs  and  the  same  rating  system  is  employed,  the 
resulting  point  totals  will  adequately  portray  their  true 
relative  worth. 

Two  importzmt  points  must  be  considered  in  rating. 
In  the  first  place,  jobs  should  be  rated  solely  on  content 
and  independent  of  title.   In  many  instances  a  job  title 
may  possess  certain  connotations  for  the  rater.  Again,  the 
title  may  be  entirely  misleading  and,  therefore,  create  in 
the  rater's  mind  a  mental  image  of  job  content  that  is 
actually  not  present.  Under  either  circumstance  bias  will 
creep  into  the  rating  with  a  consequent  reduction  in  accur- 
acy. The  net  result  will  be  to  improperly  value  the  job  in 
relation  to  other  jobs.   Second,  jobs  should  be  rated 
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independently  of  salaries  currently  paid  for  such  Jobs 
either  within  or  without  the  hospital.   Front  an  internal 
point  of  view,  salaries  should  be  determined  from  point 
ratings  and  not  vice  versa}  from  an  external  point  of  view, 
wage  rates  for  unique  Jobs,  if  they  are  available  at  all* 
ceurmot  be  relied  on  to  express  the  true  relative  value  of 
such  Jobs.   If  such  were  the  case,  there  would  be  no  need 
for  Job  evaluation  in  the  first  place. 

Controlling  the  Job  Evaluation  Plan 

Need  for  exercising  control  over  plan 

One  outstcinding  fact  is  clear  in  studying  the  exper- 
ience of  the  98  hospitals  reporting  use  of  a  formal  plan 
of  Job  evaluation:  the  most  technically  perfect  plan  cam- 
not  long  survive  unless  as  much  attention  is  given  to  its 
maintenance  as  to  its  inauguration.   In  addition,  the 
success  of  any  type  plan  apparently  depends  not  only  on 
sound  administrative  ztrrangements  amd  competent  personnel, 
but  also  on  a  recognition  of  the  limitations  of  the  plzm  as 
a  management  technique  and  the  impact  upon  it  of  changing 
internal  and  external  conditions.  As  D.  W.  Weed  dba ted:   "It 
(Job  evaluation]]  is  simply  a  tool  with  which  to  work,  and 
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to  use  that  tool  properly  a  certain  technique  must  be  re- 
quired.  That  tool  must  continue  to  be  used«  because  the 
Job  of  Job  evaluation  is  never  done.... My  advice  to  you, 
if  you  are  not  prepared  to  keep  Job  evaluation  up  to  date, 

is  not  to  use  it  at  all,  because  it  will  cause  you  more 

1 
trouble  than  it  is  worth." 

In  further  substantiation  of  this  view,  Sumner  D. 

Charm  stipulates  that  "a  single  program  of  job  analysis  and 

evaluation  is  not  the  end  of  the  project.  As  Job  changes 

come  in,  as  requirements,  products,  and  processes  change, 

the  analyses  and  evaluations  must  be  kept  up  to  date.  Job 

evaluation  must  not  be  regarded  as  automatic.   It  is  a  con- 

2 
tinuing  process." 

Any  hospital  that  is  progressive  and   dynamic  may 

be  expected  to  engage  in  a  process  of  continual  expansion 

of  its  activities:   consequently,  existing  procedures  and 

methods  of  operation  must  continually  change  in  order  to 

meet  these  changing  conditions,  A  static  situation  seldcmi 

exists  in  any  area  important  to  the  hospital  and  certainly 


D.  W.  weed,  "Maintenance  of  Wage  and  Salary 
Structures, "  National  Industrial  Conference  Board,  Studies 
in  Personnel  Policy,  No.  62,  April  1944,  pp.  14-15. 

^Charm,  op.  cit.,  p.  82. 
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not  In  an  area  assigned  the  important  responsibility  of 
determining  and  maintaining  uniform  and  equitable  rates  of 
pay.  Descriptions  from  which  evaluations  are  developed 
need  to  be  checked  periodically  in  order  to  ascertain 
vaiether  current  Job  content  agrees  with  the  description. 
Hew  jobs  will  be  created  from  time  to  time  as  well  as  the 
continual  change  in  duties  and  responsibilities  that  nor- 
mally occur  in  existing  jobs  over  a  period  of  time.  Cog- 
nizance must  be  taken  of  these  changes  whether  they  be 
gradual  or  sudden.  Every  job  should  be  re-evaluated  when- 
ever the  method  of  doing  the  job,  or  the  tools,  equipment, 
materials  or  working  conditions  differ  significantly  from 
that  indicated  in  the  job  description.  For  psychological 
reasons  it  is  important  that  the  re-evaluation  take  place 
as  soon  as  possible  after  the  changes  in  job  content  take 
place.  Even  though  changes  are  brought  about  as  needed,  the 
whole  program  should  be  reviewed  at  stated  times  during  the 
year  to  determine  whether  employees  are  doing  the  same  jobs 
for  which  they  have  previously  been  classified.  Policies 
that  have  been  developed  to  assist  in  in^lementing  the  eval- 
uation program  must  be  reviewed  from  time  to  time  in  order 
to  insure  their  conformity  to  the  requirements  of  the  hos- 
pital in  terms  of  both  its  overall  objectives  as  well  as 
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its  needs  In  the  equitable  clisbur semen t  of  vages  and  sal- 
aries. Factors  such  as  these  require  the  establishment  of 
a  set  of  procedvires  amd  controls  for  purposes  of  main- 
taining cm  adequate  monitoring  of  the  job  evaluation  plcui. 

Specific  means  of  exercising  control  over  the  lob  evaluation 

There  eure  any  number  of  reasons  vAiy  a  job  evaluation 
plan  may  falter  and  fall.  These  problem  areas  must  be 
sought  out  and  controlled.  One  of  the  greatest  causes  of 
ultimate  fallxire  of  the  job  evaluation  plan  In  the  hospital 
stems  from  allowing  arbitrary  salary  Increases  Irrespective 
of  the  rate  range  established  by  the  plan  of  evaluation. 
This  In  no  wise  suggests  that  a  restriction  be  placed  upon 
the  supervisor's  authority  and  responsibility  In  granting 
justified  merit  Increases  within  the  rate  range  as  estab- 
lished by  the  evalxiation  plan.   The  difficulty  is  encovmtered 
when  supervisors  completely  disregard  the  established 
classes  and  rate  ranges  and   arbitrarily  grant  wage  Increases 
which  cannot  be  justified  on  the  basis  of  job  worth.   In 


■'■The  concept  of  job  classes,  rate  ranges  and  merit 
rating  procedures  is  basically  a  function  of  wage  and  salary 
administration  and  consequently  is  beyond  the  scope  of  this 
study.  The  reader  is  directed  to:  David  W.  Belcher,  Wage 
and  Salary  Administration  (Englewood  Cliffs:  Prentice-Hall, 
Inc.,  1955). 
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order  to  effectively  control  this  difficulty,  the  personnel 
department  should  specify  that  all  requested  salary  in- 
creases be  cleared  through  its  office.   This  is  not  to  sug- 
gest* howQver,  that  the  supervisors  and/or  department  heads 
should  be  relieved  of  all  authority  anA   responsibility  in 
helping  to  set  job  rates  for  new  or  re-rated  Jobs.   It  must 
be  remembered  that  even  with  sm  established  system  of  rate 
review  by  the  personnel  department,  the  degree  of  success 
of  the  review  depends  upon  the  cooperation  of  supervisors 
in  reporting  job  changes.   The  requirement  that  all  rate 
changes  or  salary  increases  move  through  the  control  unit 
(the  personnel  department)  is  primarily  a  raesms  of  sub- 
jecting each  such  change  to  critical  review  in  order  to  con- 
trol those  supervisors  \*io  tend  to  be  overly  liberal  in 
gramting  increases  above  and  beyond  the  normal  rate  range 
as  established  1^  the  job  evaliiation  plan.   It  is  not  dif- 
ficult to  ascertain  whether  all  such  chamges  have  filtered 
through  the  control  unit  since  all  wage  changes  must  move 
through  the  payroll  department  where  the  information  is 
readily  available  to  the  centralized  control  unit.   It  is 
reiterated  that  such  a  procedure  should  never  be  used  as  a 
means  of  usurping  the  supervisor's  prerogative  of  adjusting 
individual  pay  within  established  rate  ranges  through  merit 
increases* 
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Admittedly,  it  will  be  necessary  in  some  instances 
to  overpay  certain  jobs  in  order  to  attract  certain  types 
of  workers  to  the  hospital.  This  should  be  ccmsidered  a 
temporary  situation  resulting  from  market  conditions.  How- 
ever, the  central  control  unit  should  be  aware  of  such  out- 
of-line  rates  so  that  corrections  may  be  made  vftien  the 
condition  of  the  market  changes  with  respect  to  demand  for 
the  type  of  worker  in  question.  The  job  evaluation  system 
itself  acts  as  an  importemt  control  device  in  this  respect 
since  it  points  out  vftiich  jobs  are  out  of  line  at  any  given 
time  emd  by  how  much  they  are  ovt   of  line. 

Another  significant  means  of  exercising  control 
over  the  evaluation  plan  in  the  hospital  is  the  require- 
ment that  all  chemges  in  the  content  of  existing  jobs  or 
newly  created  jobs  be  reported  by  department  heads  or  super- 
visors to  the  control  unit.  Here  again  it  is  imperative 
that  the  centralized  control  agency  secure  the  full  coop- 
eration of  supervisors  and  department  heads.   In  some  cases 
this  cooperation  may  not  be  forthcoming  for  amy  one  of  a 
number  of  reasons;  consequently,  it  beccMties  necessairy  to 
institute  procedures  which  will  assure  the  reporting  of  job 
changes  or  newly  created  jobs.  One  such  device  calls  for  a 
continuing  audit,  on  a  departmental  basis,  by  the  personnel 
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department  of  the  hospital  for  purposes  of  imcovering  any 
possible  changes  that  have  not  been  reported.  A  fxirther 
extension  of  this  idea  suggests  that  the  life  of  the 
Individtial  description  and  evaluation  be  limited  to  a 
definite  period  of  time  after  which  a  restudy  of  the  job 
becomes  mandatory.  In  order  to  keep  abreast  of  job  changes, 
in  some  cases  it  might  be  advisable  to  institute  a  new 
analysis  and  re-evaluation  of  the  job  whenever  a  hiring, 
promotion  or  transfer  of  employees  takes  place.  This  pro- 
cedure may  not  be  sufficient  in  itself;  however,  used  in 
conjunction  with  other  means  of  control  it  would  prove  of 

value . 

In  the  event  the  supervisor  fails  to  report  a  new 
job,  the  central  control  unit  might  readily  uncover  such  in- 
formation through  comparing  the  list  of  current  employees 
with  the  job  budget  or  table  of  organization  for  the  depart- 
ment in  question. 

Another  means  of  monitoring  the  evaluation  plan  is 
in  terms  of  consolidations  and  revision  of  jobs  as  a  result 
of  changes  in  organization.  Organization  patterns  and  re- 
sponsibilities are  not  Static j  they  are  fluid  because  of  the 
changing  requirements  of  the  hospital,  the  medical  staff, 
and  modern  trends  in  hospital  care.  However,  changes  in 
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Jobs  must  be  determined  by  methods  of  orgemization  and 
assignment  of  responsibility.   Periodic  review  of  the  or- 
gemizatlon  emd  the  manner  In  ^Ich  jobs  are  performed  and 
rated  will  help  ensure  that  the  original  job  classification 
and  pay  plam  continues  to  fit  the  hospital  personnel 
structure.   Responsibilities  of  Jobs  may  be  increased  or 
decreased  thereby  affecting  the  established  value  of  the 
Job.   In  addition  to  periodic  reviews  to  ascertain  organi- 
zational changes  as  they  affect  Job  content,  each  depart- 
ment head  or  supervisor  should  be  urged  to  request  a  Job 
review  when  he  believes  an  existing  Job  has  been  changed, 
deleted  or  consolidated  with  another  or  that  a  new  Job  has 
been  created  as  a  result  of  structural  changes. 

One  of  the  most  difficult  aspects  of  the  evaluation 
plan  to  control  is  the  variation  in  rating  resulting  frcwn 
continxial  cheuige  in  the  rating  group.   Serious  discrepancies 
in  rating  and  classifying  Jobs  may  result  frcwi  failure  to 
provide  for  control  of  consistency  of  rating  by  maintaining 
a  permanent  rating  team.   If  a  particular  group  cannot 
possibly  be  kept  intact  for  future  rating  and  rerating,  at 
least  one  member  of  the  committee  should  be  maintained  in 
order  to  give  some  degree  of  continuity  to  the  philosophies 
developed  and  embodied  in  the  initial  program  of  evaluation. 
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In  conclusion,  it  should  be  reiterated  that  all  the 
mechanical  control  procedures  in  the  world  ceumot  possibly 
comprehend  all  job  changes  vdthout  the  assistance  and 
cooperation  of  those  directly  responsible  for  said  Jobs. 
Consequently,  the  most  productive  course  of  action  is  to 
acquaint  supervisors  and  department  heads  with  the  neces- 
sity of  continually  assessing  Job  changes  which  might 
well  affect  the  wage  equilibrium  in  their  depaxrtments. 
Stress  should  be  laid  on  the  advantages  vAiich  will  accrue 
to  the  supervisor  if  relative  equality  of  Job  values  is 
maintained.   This  can  only  be  accomplished  if  duties  and 
responsibilities  of  each  job  are  properly  assessed  and 
any  significant  chamges  reflected  immediately  in  a  proper 
wage  adjustment. 
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APPENDIX  A 


COLLEGE  OF  WILLIAM  AMD  MABY 

BUREAU  OF  BUSINESS  RESEARCH 

NORFOUC,  VIRGINIA 


CONFIDENTIAL 

Job  Evaluation  and  Wage  Administration  Questionnaire 

The  Btireau  of  Business  Research  assures  all  cooper- 
ating Hospitals  that  no  individual  replies  will  be  made 
available  to  others  and  that  only  summarized  results  will 
be  pviblished. 

This  questionnaire  essentially  involves  a  simple 
checklist  on  policies  and  practices  of  Job  evaluation  in 
your  Hospital.   Please  check  all  individual  subheadings 
which  pertain  to  practices  in  your  organization.   (NOTE: 
Even  if  you  have  no  formal  job  evaluation  program,  please 
answer  questions  1  through  9  and  retujm  the  sheet  so  that 
the  survey  may  be  complete) 

If  you  desire  a  stmmiary  of  the  findings  of  this  sur- 
vey, please  Include  the  following  information: 

Name  of  Hospital  : 
Address  t 

Respondent       t  Title  » 


1.  Has  your  Hospital  made  a  job  analysis  of  all  positions 
and  set  up  a  written  description  of  job  content. 

Yes     NO     Partial 

(If  available,  receipt  of  a  sample  description  would 
be  helpful) 

2.  Which  of  the  following  method(s)  were  used  to  secure  in- 
formation for  the  job  descriptions. 

Employee  interviewed  on  the  job 

^Supervisor  or  department  head  Interviewed  on  the  job 

Questionnaire  filled  in  by  employee 

Questionnaire  filled  in  by  supervisor  or  department 

head 

Interview  and  questionnaire  from  employee 

Interview  amd  questionnaire  from  supervisor  or  depart- 
ment head 
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Job  descriptions  written  by  employees 
Job  descriptions  written  by  supervisors  or  depart- 
ment heads 
Other  (please  specify) 

3.  Final  job  description  is  approved  byt 

Department  Head     Supervisor        Employee 

4.  Does  your  Hospital  make  smy  type  of  community  wage 
survey  at  present  to  help  in  setting  wage  rates. 
Yes     No 

5.  If  survey  is  undertaken,  it  is  accomplished  throught 
Mail     Interview     other  (specify) 

6.  In  conducting  the  survey,  are  job  descriptions  rather 
than  job  titles  used  in  securing  wage  information. 
Yes     No 

7.  What  types  of  jobs  do  you  seek  wage  information  on. 
Any  or  all  types     ^So-called  "key  jobs" 

8.  If  answer  to  question  (4)  is  "Yes",  \*ich  of  the 
following  sources  do  you  contact. 

Local  businesses  or  industrial  concerns  (hotels, 

laundries,  etc.)  Government  wage  surveys 

Local  Hospital  Council        ^State  Hospital  Assoc- 

American  Hospital  Association      iation 

Nurses  Association  ^Professional  Assocl- 

Waqe  surveys  (Bell  Telephone,      ations 
NOMA,  etc.)  Local  unions 

Others  (please  specify) 

If  answer  to  question  (4)  is  "Yes",  how  often  are  such 
surveys  made. 

^Semi-annually     As  needed 

Annually         Other  (specify) 


9.   Present  status  of  Job  Evaluation  in  your  Hospital. 

No  formal  program  in  effect  cUid  no  plan  to  Install 

at  present 

Formal  plem  now  in  effect 

Installing  foinnal  plan  at  present  time 

^Plemnlng  to  Install  formal  plan  in  the  near  future 

10.   lype  of  Job  Evaluation  plan  in  effect  in  your  Hospital. 

Ranking  system 

(Involves  a  simple  ranking  of  jobs  based  on  a  con- 
sideration and  comparison  of  several  job  character- 
istics or  factors) 
Grading  or  Classlfiratlon  system 

(Involves  setting  up  several  major  grades  or 
classes  and  then  placing  individual  jobs  into  the 
proper  grade  or  class) 
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^Polnt  system 

(Job  characteristics  are  defined  and  a  scale  Is 
provided  v^lch  defines  various  degrees  of  each 
characteristic.   Each  degree  includes  a  range 
of  points  from  vdilch  the  apprcecimate  point  value 
is  selected.   The  combined  points  are  totaled  to 
provide  an  overall  point  value  for  each  job) 
Factor  Comparison  system 

(Job  characteristics  that  make  up  value  of  any 
job  are  defined.   Key  jobs  are  selected  and 
analyzed  factor  by  factor.   It  is  decided  how 
much  of  current  wage  for  each  job  is  being  paid 
for  each  factor.  These  breakdowns  of  key  jobs  are 
used  as  a  scale  against  which  other  jobs  are 
measured  to  determine  relative  money  values) 

Other  (Please  describe  on  a  separate  sheet) 

11.  If  you  do  have  a  formal  job  evaliation  plan,  in  v*iat 
year  was  it  established.  

12.  How  long  did  it  take  to  install  your  plan. 


13.  Reasons  for  installing  your  Job  Evaluation  progreun. 

To  improve  administration  of  wage  and  salary  program 

To  create  equity  in  wage  and  salairy  program 

To  better  control  wage  and  salary  costs 

To  provide  factual  data  for  determining  relative 

worth  of  jobs 
To  give  management  a  more  sxibstcintial  foundation 
for  its  case  on  wage  issues  in  collective 
bargaining 

To  reduce  grievances  and  employee  turnover 

To  keep  out  of  the  union 

To  establish  a  basis  for  placement  and  promotbn 

^Others  (specify  please) 

14.  Methods  used  to  secure  acceptance  of  your  Job  Eval- 
uation program. 

Dept.  Heads  Supervisors  Employees 

Participation  ____     

Letter  or  memo  from 

Administrator  ___^_     ___        

Staff  meetings  ____        

Dept.  group  meetings      ____^        

Individxial  conferences     ___^     

Descriptive  literature     _^___     

Employee  publications      ____      

Union  representatives      ^ 

Conferences  with  employee 

leaders  _____     

Other  (please  specify)     ____________________________ 
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15.  Individual  or  group  responsible  for  following  activ- 
ities of  program: 

Developing  and  Installing         Pay-to-day  Operation 

Administrator  and/or  Assistant  

Personnel  Department  of  Hospital         

_____  Job  Evaluation  Committee  ^ 
_____  Outside  consultant  ____ 
Other  (please  specify) 

16.  If  a  Job  Evaluation  Committee  was  used,  please  list  the 
titles  of  those  who  comprised  the  committee 


17.   Person (s)  \^o  actually  rated  the  jobs.  (Title) 


18.  Was  the  immediate  supervisor  automatically  included  in 
the  rating  group. 

Yes     No 

19.  Rcuige  of  Jobs  rated  in  your  program. 

Professional  (Registered)        Technicians  (Non- 

Office  and  clerical  Registered) 

All  employees  up  to  but  not  including  department  heads 

All  employees  through  department  heads:  Administra- 
tor 
Unskilled  workers 

20.  Do  you  use  the  same  evaluation  system  unchanged  for 
the  entire  range  of  jobs. 

Yes     ^No 

21.  Nximber  of  employees  covered  in  your  evaluation  program. 


22.  If  you  use  the  Point  or  Factor  Comparison  plan   of 
evaluation,  please  list  on  a  separate  sheet  the 
factors  used  in  rating  the  jobs.   (Receipt  of  a  copy 
of  rating  scales  would  be  most  helpful) 

23.  Have  you  ever  attempted  to  simplify  your  job  evaluation 
program — to  achieve  the  same  results  with  fewer  rating 
factors. 

Yes     NO 

24.  How  many  labor  grades  does  your  finished  wage  curve 
include.  

25.  Did  you  use  statistical  measures  to  determine  one  best 
set  of  factors  and  weights,  in  other  words  to  validate 
your  system. 

Yes     No 
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26.  Have  you  made  some  check  upon  the  relisQjllity  of 
your  system — that  is,  the  consistency  with  v>hich  you 
can  use  it  from  time  to  time  for  the  same  jobs,  or 
the  consistency  with  which  you  and  others  using  it 
independently  on  the  szune  jobs  come  up  with  the  same 
results. 

Yes     No 

27.  Operating  problems  encountered  in  your  plcui. 

Lack  of  experienced  personnel  to  administer  the 

plan 
Keeping  Administrators  and  supervisory  group  "sold" 

on  job  evaluation 

Insuring  uniform  interpretation  of  the  program 

jKeeping  everyone  informed  on  changes  that  occur  in 

the  program 

Efficient  and  effective  handling  of  rate  grievcuices 

^Pressure  to  increase  individual  rates  above 

evaluated  rate  for  job 
___jGetting  changes  in  jobs  and  new  jobs  reported 

promptly 
^Other  (please  specify) 

28.  Msmner  in  which  control  of  job  evaluation  plan  is  ex- 
ercised. 

Person  or  area  administering  centralized  control 

Types  of  control: 
All  salary  increases  cleared  through  centralized 

control  unit 
^Supervisor  or  department  head  reports  all  job 

changes  to  centralized  control  unit 
^Supervisor  or  department  head  reports  all  new  jobs 

to  centralized  control  luiit 

Records  corrected  immediately  to  record  changes 

____Close  observation  of  day-to-day  functioning  to 

ascertain  weaknesses 
_Other  (please  specify) 


29.   Relative  satisfaction  or  dissatisfaction  with  your 
evaluation  program. 

^Highly  satisfactory     Fairly  satisfactory 

^Satisfactory  Definitely  vmsatisfactory 

(Please  specify  major  reason  or  reasons  for 
above  choice) 
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APPENDIX  B 


COLLEGE  OF  WILLIAM  AND  MT^BY 
IN  NORFOLK 

Hampton  Boulevard  and  Boiling  Avenue 

BUREAU  OF 
BUSINESS  RESEARCH  Norfolk  8,  Virginia 


Mr.  Charles  M.  Rice 
4311  Dohn  Avenue 
Louisville  16,  Kentucky 

Dear  Mr.  Rice: 

The  Administrator  of  a  medivun- sized  hospital  recently 
confided  to  me  that  a  large  segment  of  his  employees  were 
collectively  demanding  a  40  cents  per  hoxir  "across  the 
board"  wage  increase.   He  was  aware  that  wages  were  not 
"in  line"  in  every  case — a  situation  which  would  lead  to 
a  much  greater  cost  in  any  subsequent  wage  increase.   In 
an  effort  to  offset  this  difficulty,  the  Administrator 
took  the  logical  course  of  action — he  had  a  job  evaluation 
program  installed  in  the  hospital. 


This  course  of  action  saved  the  hospital  considerably 
more  than  $10,000  in  final  wage  increases.   Furthennore, 
job  relationships  were  now  internally  consistent. 

Would  you  be  interested  in  finding  out  what  hospitals 
throughout  the  country  are  doing  by  way  of  formalizing 
wage  and  salary  programs?  The  Bureau  of  Business  Research 
of  the  College  of  William  and  Mary  is  undertaking  a  study  of 
the  problem.   Just  a  few  minutes  to  fill  out  and  return  the 
enclosed  survey  sheet  will  make  this  information  available 
to  you. 
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Mr.  Charles  M,  Rice 
Page  two 


May  we  have  your  help  in  this  project?  The  results 
will  net  only  assist  you  in  maXing  decisions  in  this  area 
but  will  also  contribute  to  an  advance  of  knowledge  in 
the  field  of  Hospital  Administration. 

Your  cooperation  is  appreciated! 

Cordially, 


A.  F.  Belote,  Assoc.  Prof, 
Department  of  Management 


AFB/sll 
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APPENDIX  C 


COLLEGE  OF  WILLIAM  AND  MARY 
IN  NORFOLK 

H2unpton  Boulevard  and  Boiling  Avenue 
Norfolk  8,  Virginia 

August  10,  1960 


Mr.  John  J.  Delaney 
Personnel  Director 
St.  Joseph's  Hospital 
703  Main  Street 
Trenton,  New  Jersey 

Dear  Mr.  Delaney: 

On  behalf  of  the  B\ireau  of  Business  Research  of  the  College 
of  William  and  Mary  in  Norfolk  let  me  thank  you  for  making 
the  information  concerning  your  job  evaluation  progrsun 
available  for  analysis. 

During  the  past  several  months  I  have  made  a  rather  exten- 
sive personal  survey  covering  some  60  odd  hospitals  and, 
along  with  the  mailed  survey  v4iich  went  to  over  800  hos- 
pitals, have  discovered  26  point  plzms  already  in  operation 
and  23  more  being  installed,  at  present,  v^ich  we  would  like 
to  analyze  in  more  detail.   It  is  oxir  opinion  that  the  point 
system  in  job  evaluation  lends  itself  to  more  quantitative 
emalysis  than  emy  of  the  other  plans  and,  consequently,  con- 
stitutes a  superior  method  of  valuing  jobs. 

In  order  to  make  a  more  detailed  comparison  of  each  of  these 
point  plans  we  are  asking  each  hospital  to  send  us  a  list  of 
the  factors,  degrees  and  points  used  in  their  particular 
system.  We  are  interested  in  such  data  in  order  to  learn 
vfliether  there  might  be  any  optimal  number  or  weightings  of 
factors  and  degrees.  Rest  assured  that  all  information  will 
be  held  in  the  strictest  confidence  with  only  summarized 
results  being  sent  to  individual  hospitals. 
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Mr.  John  J.  Delaney 
August  10,  1960 
Page  two 


In  addition,  we  are  trying  to  learn  more  about  the  philosophy 
and  methodology  behind  the  development  of  the  point  system 
of  Job  evalxiation  in  the  hospital.  Consequently,  we  would 
be  very  appreciative  if  you  would  be  so  kind  as  to  supply 
us  with  answers  to  several  questions  relative  to  your  pro- 
gram.  Please  understand  that  these  questions  are  asked  of 
each  of  the  aforementioned  hospitals  vftiich  has  developed  a 
point  plan,  in  order  that  we  might  better  discover  areas  of 
relative  consistency  in  approach  to  hospital  job  evaluation 
development.  We  believe  such  infomnation  as  can  be  gleaned 
from  the  following  questions  will  make  a  real  contribution 
to  the  field  of  hospital  admin istr at ion j 

1.  How  was  a  determination  made  as  to  v^ich  factors 
to  use  in  your  program? 

2.  Have  you  ever  attempted  to  simplify  your  job  eval- 
uation program  (to  achieve  same  results  with 
fewer  rating  factors)?  Also,  what  procedure 

was  used? 

3.  How  was  the  relative  percentage  distribution  of 
points  among  the  factors  derived? 

4.  How  were  the  relative  degree  weightings  within 
each  factor  determined? 

5.  How  did  you  arrive  at  the  number  of  degrees  to 
use  within  each  factor? 

6.  How  were  the  point  ranges  for  labor  grades  de- 
cided upon?   (Would  appreciate  receipt  of  a 
table  of  labor  grade  point  ranges  for  ccsnparison 
purposes.) 

7.  Does  your  system  use  a  "rate  remge"  within  each 
labor  grade?  If  so,  v^at  is  the  percentage  of 
each  grade? 

8.  If  rating  points  were  correlated  with  salaries 
(either  mathematically  or  on  a  scatter  diagram) , 
did  you  use  internal  or  external  wage  information? 

9.  How  was  the  base  rate  line  (regression  or  midpoint 
line  or  curve  through  the  rate  ranges)  established? 

10.  What  statistical  measures  were  used  to  determine 
the  one  best  set  of  factors  and  weights,  in  other 
%*ords,  to  validate  your  system? 
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11.  How  did  you  go  about  checking  on  the  reliability 
of  your  program,  that  is,  the  consistency  with 
vdiich  you  and  others  using  it  independently  on 
the  same  jobs  came  up  with  the  same  results? 

12.  What  is  the  basis  or  policy  for  tying  your  wage 
curve  to  going  market  rates? 

Again,  let  me  thank  you  for  your  time  and  effort  in  helping 
us  to  try  to  stir  up  more  interest  on  the  part  of  hospital 
administrators  emd  personnel  directors  in  this  highly  use- 
ful program. 

As  soon  as  the  survey  results  are  tabulated  eind  analyzed 
you  will  receive  a  copy. 

Best  wishes  for  success  with  your  plan. 

Cordially, 


A.  P.  Belote,  Associate  Professor 
Department  of  Management 

AFBsJm 
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APPENDIX  D 


Hospitals  Included  in  the  Personal  Survey 
(By  City  and  State) 


District  of  Columbia  (Washington) 

Doctor's  Hospital,  D.  C. 

District  of  Columbia  General  Hospital,  D.  C, 

District  of  Columbia  Village  Hospital,  D.  C, 

Freedmrn's  Hospital,  D.  C. 

George  Washington  University  Hospital,  D.  C. 

Georgetown  Hospial,  D.  C. 

Providence  Hospital,  D.  C. 

Washington  Hospital  Center,  D,  C. 

Florida 

Alachua  General  Hospital,  Gainesville 

Baptist  Memorial  Hospital,  Jacksonville 

Duvual  Medical  Center,  Jacksonville 

J.  Hillis  Miller  Health  Center,  Gainesville 

St.  Lukes  Hospital,  Jacksonville 

St.  Vincents  Hospital,  Jacksonville 

Maryland 

Baltimore  City  Hospitals,  Baltimore 
John's  Hopkins  Hospital,  Baltimore 
Maryland  General  Hospital,  Baltimore 
Sinai  Hospital,  Baltimore 
St.  Josephs  Hospital,  Baltimore 
Union  Memorial  Hospital,  Baltimore 
University  Hospital,  Baltimore 

New  York 

Beekmam  -  Downtown  Hospital,  New  York  City 
Foundling  Hospital,  New  York  City 
Lennox  Hill  Hospital,  New  York  City 
Manhattan  General  Hospital,  New  York  City 
Mt,  Sinai  Hospital,  New  York  City 
Memorial  Hospital,  New  York  City 
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New  York  -  Cornell  Hospital,  New  York  City 
Presbyterian  Hospital,  New  York  City 
Roosevelt  Hospital,  New  York  City 
St.  Lvikes  Hospital,  New  York  City 

North  Carolina 

Onslow  County  Hospital,  Jacksonville 

Pennsylvania 

Charleroi— Monessen  Hospital,  Pittsburgh 

Childrens  Hospital,  Pittsburgh 

Chester  Hospital,  Chester 

Episcopal  Hospital,  Philadelphia 

Elizabeth  Steel  Magee  Hospital,  Pittsburgh 
*Home stead  Hospital,  Homestead 

Hahnemann  Hospital,  Philadelphia 

Jefferson  Medical  College  Hospital,  Philadelphia 
♦Latrobe  Hospital,  Latrobe 

Methodist  Episcopal  Hospital,  Philadelphia 

Montefiore  Hospital,  Pittsburgh 

Pennsylvania  Hospital,  Philadelphia 
♦Sewickley  Valley  Hospital,  Sewickley 

Shady side  Hospital,  Pittsburgh 

St.  Lukes  euid  Childrens  Medical  Center,  Philadelphia 

St.  Agnes  Hospital,  Philadelphia 
•Titusville  Hospital,  Titusville 

Temple  University  Hospital,  Philadelphia 
•Washington  Hospital,  Washington 

Western  Pennsylvania  Hospital,  Pittsburgh 

Westmoreland  Hospital,  Pittsburgh 
♦Greater  Pittsburgh  Area 

South  Carolina 

Medical  College  Hospital,  Charleston 
Roper  Hospital,  Charleston 

Virginia 

Leigh  Memorial  Hospital,  Norfolk 
Norfolk  General  Hospital,  Norfolk 
Obesi  Hospital,  Portsmouth 
Riverside  Hospital,  Newport  News 
St.  Vincent  DePaul  Hospital,  Norfolk 
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APPENDIX  E 

HOSPITAL  JOB  EVALUATION 
MANUAL 


DEFINITIONS  OF  FACTORS  USED 
IN  RATING  HOSPITAL  OCCUPATIONS 


The  following  memual  is  to  be  used  in  connection  with  the 
master  rating  plan  for  use  in  rating  hospital  jobs  as  pre- 
sented in  Chapter  IV.   The  factors  used  were  selected  in  an 
effort  to  ensvire  adequate  coverage  of  all  facets  of  hos- 
pital operation.   Factor  weightings  and  degree  progressions 
were  developed  from  an  analysis  of  numerous  hospital  job 
evaluation  plans.   The  methodology  of  application  is  dis- 
cussed in  detail  in  the  body  of  the  report. 
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FACTOR  #1 

EDUCATION 

Degree        123456  7  8  9 

Points   15   26    34   46   62   83   111   149    200 

This  factor  measures  that  part  of  the  basic  knowledge  re- 
quired to  perform  the  duties  involved  in  the  job  and  in- 
cludes all  systematic  instruction  initially  required  of  an 
individual  to  be  capable  of  performing  a  given  job  satis- 
factorily. 


Degree 


1.  Ability  to  follow  simple  oral  or  written  instructions. 
Little  education  required. 

2.  Make  simple  arithmetic  calculations.  Working  know- 
ledge of  routine  methods,  ability  to  perform  simple 
routine  tasks,  ability  to  read,  speak  and  write 
English.  Equivalent  to  an  elementairy  education. 

3.  Understamd  elementary  principles  of  a  science  and 
act  according  to  general  instructions.  Obtain 
simple  information  from  charts  or  records.  Know- 
ledge of  simple  methods,  procediures  or  processes. 
Equivalent  to  a  high  school  education. 

4.  Practical  knovrledge  of  a  science,  a  specialized 
field  or  a  technical  subject.   Equivalent  to  two 
years  of  college,  business  or  trade  school. 

5.  Completion  of  courses  necessary  to  qualify  for  a 
college  degree  in  a  technical  field,  science, 
liberal  arts,  or  education. 

6.  Ability  to  organize  and  apply  an  exact  classified 
knowledge  of  a  technical  or  a  master's  degree  or  a 
bachelor's  degree  and  a  formal  internship. 

7.  Ability  to  organize  and  apply  an  exact  classified 
knowledge  of  a  technical  or  professional  field 
usually  requiring  up  to  20  years  of  formal  edu- 
cation. 
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8.  Ability  to  organize  and  apply  an  exact  classified 
knowledge  of  a  technical  or  professional  field 
usually  requiring  up  to  22  years  of  formal  edu- 
cation. 

9.  Ability  to  organize  and  apply  an  exact  classified 
knowledge  of  a  technical  or  professional  field 
usually  requiring  as  a  minimum  more  than  22  years 
of  formal  education. 
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FACTOR  #2 

EXPERIENCE 

Degree  123456  7  8 

Points   15   21    29   40    56   77    108   150 

This  factor  measures  the  length  of  time  required  for  an 
average  employee.   With  the  necessazry  educational  back- 
ground, to  become  proficient  in  perfoirming  the  duties 
involved  in  the  job. 

Degree 

1.  Up  to  and  including  1  month  of  experience. 

2.  Up  to  and  including  3  months  of  experience. 

3.  Up  to  and  including  6  months  of  experience. 

4.  Up  to  and  including  1  year  of  experience. 

5.  Over  1  year  but  not  in  excess  of  2  years  exper- 
ience. 

6.  Over  2  years  but  not  in  excess  of  3  years  exper- 
ience. 

7.  Over  3  years  but  not  in  excess  of  6  years  exper- 
ience. 

8.  Over  6  years  but  not  in  excess  of  10  years  exper- 
ience. 
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FACTOR  #3 

INITIATIVE  AND  JUDGMENT  REQUIRED 

Degree  123456  7  8 

Points   15   21   29   40   56   77   108   150 

This  factor  measures  the  extent  to  vAiich  successful  exe- 
cution of  the  position  content  requires  the  exercise  of 
resource fulness«  independent  action,  adaptability  and 
aggressiveness  and   the  necessity  to  cope  with  deviations 
outside  the  control  of  supervision.   It  involves  the 
necessity  to  anticipate  amd  provide  for  changing  condi- 
tions; it  is  the  degree  of  complexity  of  the  work,  the 
amovmt  and  quality  of  Judgment  required  and  the  necessity 
to  grasp  essentials,  draw  sound  conclusions  and  plan  a 
mode  of  action. 


Degree 


1.  A  minimum  degree  of  independent  action  and 
aggressiveness  required.  Duties  are  routine  and 
simple  in  nature  and  require  few  decisions. 

2.  Some  independent  action  for  making  minor  decisions 
within  the  limits  of  established  routine.   Duties 
are  repetitive  and  the  work  is  closely  supervised. 

3.  Performs  diversified  but  semirepetitive  operations 
following  standardized  methods  and  procedures. 
Average  amount  of  perseverance  required  to  carry 
through  the  job.  Analyzes  figures  or  data  of  mod- 
erate complexity,  sometimes  varied  in  content. 

4.  Above  average  amount  of  independent  and  individual 
action,  standard  methods  and  procedures  are  gen- 
erally but  not  always  available. 

5.  Frequent  decision  -  making  and  self-reliance 
occasioned  by  frequently  changing  situations  or 
conditions.   Duties  are  technical  or  complicated 
in  nature.  Any  supervision  reached  is  of  a 
general  nature. 
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6.  Continual  exercise  of  independent  judgment  in 
gathering  diversified  specialized  data.  Some 
ability  to  evaluate  figures,  results,  data  or 
trends,  or  carry  out  the  solution  of  fairly  dif- 
ficult problems  of  a  major  department.  Direction 
received  consists  of  assignment  to  theproblem 
and  discussion  of  its  natxire. 

7.  Appraise  and  analyze  figures,  results,  data  and 
trends  for  basing  future  policy  of  a  major  depart- 
ment of  the  hospital.  Commit  the  hospital  finan- 
cially under  supervision  or  within  prescribed 
limits.  Develop  new  ideas  xinder  general  direction; 
act  independently  in  an  established  field.   No 
supervision  required  except  to  keep  superior 
informed  of  progress. 

8.  Pioneer  type  of  work  or  direction  of  work  of 
several  major  departments  with  highly  trained 
persons  performing  varied  activities. 
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FACTOR 

#4 

PATIENT  CARE  AND  SAPETX" 

3 

4 

5 

Degree     1     2 

6 

Points    10    15 

26 

49 

67 

90 

The  factor  measures  the  extent  to  v^ich  the  requirements 
of  the  position  emd  the  satisfactory  performance  of  duties 
has  a  direct  or  indirect  effect  on  the  patient's  comfort 
and  well-being,  either  from  a  physical  or  mental  health 
standpoint. 


Degree 


1.  Little  or  no  contact  with  patients.  Duties  not 
directly  related  to  patient  comfort  or  well-being. 
Relationship  based  only  on  possible  indirect 
effect. 

2.  Occasional  contact  with  patient  or  primarily  ad- 
ministrative responsibility  involved.  Only  slight 
possibility  of  affecting  patient's  mental  or 
physical  well-being, 

3.  Some  contact  with  patient  required  or  if  direct 
contact  not  required,  nature  of  duties  could  have 
definite  effect  on  patient's  mental  or  physical 
well-being. 

4.  Frequent  contact  with  patient  at  what  are  usually 
prescribed  intervals.  Routine  direct  nonmedical 
or  nonntirsing  patient  care  may  be  involved. 

5.  Very  frequent  contact  with  patients.  Duties  re- 
quire contact  for  purposes  of  administering  to  the 
need  of  the  patient  and  administration  of  routine 
medical  or  nursing  care. 

6.  Special  care  of  patient  or  contact  involving  a 
specific  and  complex  type  of  professional  or  tech- 
nical care.  Duties  involve  administering  to  the 
need  of  the  patient  and  the  practice  of  the  more 
complex  professional  and  nursing  techniques. 
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FACTOR  #5 

PERSCMTAL  CONTACTS  AND   PUBLIC   REIATIONS 

Degree  12  3  4  5  6 

Points    10   15   26   49   67   90 

This  factor  measures  the  frequency  and  importance  of 
contacts  with  other  employees,  doctors,  suppliers,  the 
general  public  and  patients*  families  and  the  extent  to 
\^ich  personality,  proper  conduct  and  tact  are  necessary 
to  create  and  maintain  desirable  relationships. 


Degree 


1.  Only  minimum  amoiuit  of  cooperation,  pdse  eind  self- 
expression.  No  contacts  with  public.  Only  contacts 
usually  with  immediate  associates  and  ordinary 
courtesy  necessary  to  avoid  friction  in  these  re- 
lationships, 

2.  Contact  and  cooperation  occasionally  with  others 
beyond  immediate  associates.  Public  contacts  of 
a  strictly  routine  nature.  Contact  is  of  such  a 
nature  that  no  decision  vAiich  needs  approval  is 
involved,  nor  is  there  any  responsibility  to  get 
approval . 

3.  Frequent  interdepartment  contacts,  such  as  those 
required  in  coordination  of  work.   Requires  av- 
erage amount  of  poise  and  tact  in  discussing 
problems  and  presenting  material  or  information, 
but  decisions  made  by  others. 

4.  Job  demands  constant  contact  with  other  depart- 
ments and  frequently  with  individuals  in  adminis- 
trative or  executive  positions  within  the  hos- 
pital. Consulting  on  problems  and  presenting 
information  or  suggestions.   Requires  judgment 
and  tact  in  presentation  to  obtain  cooperation 

or  approval  of  action. 
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5.  Contacts  within  hospital  viheze   poor  handling  may 
lead  to  poor  coordination  of  work  between  important 
departments  or  phases  of  activity,  or  v*iich  may 
have  considerable  effect  upon  interdepartment  re- 
lations.  Contacts,  generally  with  patient's  fam- 
ilies or  public,  vAiere  lack  of  tact  may  result  in 
loss  of  good  will  or  of  prestige. 

6.  Frequent  and  specialized  contacts  with  public  or 
others  of  such  a  natxure  that  failure  to  exercise 
considerable  judgment  in  developing  contacts  and 
maintaining  good  relations  may  result  in 
in^orteuit  delays  or  losses  to  the  hospital. 
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FACTOR  #6 

EFFECT  OF  ERRORS  -  DEPENDABILITY  AND  ACCURACY 

Degree    12    3    4    5 

Points    5   15   27   42   60 

This  factor  applies  primarily  to  clerical  positions  for 
copying,  posting  and  calculating,  filing  and  the  like. 
Also,  those  portions  of  other  positions  where  strictly 
clerical  work  or  where  possible  loss,  waste,  or  damage 
to  material  and  equipment  is  involved.  The  degree  to 
which  this  factor  is  applicable  to  a  given  position  is 
dependent  upon  the  dollar  or  delay  costs  of  probable 
clerical  or  handling  errors  over  a  period  of  a  year  and 
the  probability  of  the  errors  being  discovered. 


Degree 


1.  Little,  if  any  responsibility  for  accuracy. 
Errors  can  be  quickly  and  easily  detected. 

2.  Responsibility  for  accuracy  in  the  performance 
of  routine  work,  only.   Possibility  of  loss, 
waste  of  materials,  delay,  or  damage  is  slight. 

3.  Moderate  responsibility  for  accuracy  emd  depend- 
ability. Loss  through  errors  may  cause  moderate 
delay  or  loss,  waste  of  materials,  or  damage. 

4.  Responsibility  for  high  degree  of  accuracy  and 
moderate  factual  dependability  in  assembling  and 
presenting  data  which  would  entail  moderate  de- 
lay or  loss,  waste  of  materials,  or  damage. 

5.  High  factual  accuracy  and  dependability  in  working 
with  and  collecting  technical  or  scientific  data, 
or  the  preparation  and/or  disbursement  of  medical 
scientific  material.  Due  to  detailed  nature  of 
work  and  impossibility  of  close  supervision, 
thoroughness,  and  reliability  are  essential  or 
definite  serious  loss,  delay,  waste,  or  deunage 
will  result. 
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FACTOR  #7 

SUPERVISION  OF  OTHERS 

3     4 

Degree    1     2 

5 

Points    5    15 

27    42 

60 

This  factor  measxires  the  direction,  guidance  and  control 
of  the  work  of  others.   It  appraises  the  kind  and  extent 
of  the  position's  supeirvisory  authority  in  planning, 
orgemizing,  assigning,  advising  and  coordinating  the  vrork 
of  other  persons  or  units  with  responsibility  for  quality 
and/or  quantity  of  work  performed. 


Degree 


1.  Works  with,  instructs  and/or  guides  employees 
engaged  in  duties  of  routine  or  repetitive  nature. 
Assignment  of  work  and  follow-up  to  assure 
proper  completion. 

2.  Assigns  work  to  others  and  explains  routine 
methods  and  the  application  of  prescribed  pro- 
cedures with  accountability  for  quality  or 
quantity  of  work. 

3.  Solves  problems  arising  in  the  course  of  the  work 
and  reviews  the  results  for  adequacy  and  compli- 
ance with  instructions  and  procedures.  Responsible 
for  the  quality  and   quantity  of  the  work  of  sub- 
ordinates.  Supervision,  advice  and  technical 
direction  provided  to  others  from  a  staff  capacity 
\^ere  direct  contact  is  necessary  under  noinnal 
lines  of  authority. 

4.  Adapts  the  planned  program  in  terms  of  changing 
work  loads.   Sexrves  as  a  reference  or  council  on 
important  problems.   Responsible  for  quality  and 
quantity  of  the  total  work  output.   Participation 
in  the  formulation,  interpretation  and   application 
of  organization  policy. 
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5.  Coordinates  the  work  programs  of  all  departments 
with  full  accountability  for  the  general  effective- 
ness of  all  operations. 
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FACTOR  #8 

MENTAL  APPLICATION  OR  EFFORT 

Degree     12    3    4    5    6 

Points    10   15   26   49   67   90 

This  factor  measures  the  quantity  and  continuity  of  mental 
energy  required  for  the  position.   Measurement  must  be 
only  on  the  basis  of  the  intensity  and  continviity  of 
mental  activity,  rather  than  on  the  basis  of  the  complexity 
of  the  problems  involved.  Considerations  affecting  this 
factor  arej  mental  alertness,  concentration,  continuity 
of  thought  and  analytical  requirements. 


Degree 


1.  A  minimum  of  mental  application  in  the  performance 
of  repetitive  operations  vdiere  routine  is  practi- 
cally automatic. 

2.  Light  mental  application.  Work  is  mostly  semi- 
automatic and  seldom  mentally  confining. 

3.  Moderate  mental  application  in  the  performance  of 
variable  operations.   Sustained  mental  attention 
for  long  periods  of  time,  such  as  two  hours,  is 
seldom  required. 

4.  Considerable  mental  application  in  the  performance 
of  work  v^ich  is  mostly  variable.  Requires  sus- 
tained mental  attention  for  long  periods,  such  as 
two  hours  at  a  time. 

5.  Constant  mental  application  on  highly  variable 
operations  involving  considerable  detail.  Heavy 
work  flow  requires  a  high  degree  of  attention  and 
concentration. 
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6,  Intense  mental  application  in  the  performance 
of  work  dealing  with  technical  and/or  intangible 
problems.  Requires  extreme  care  and  attention 
in  all  phases.   Job  pressure  is  evident  because 
of  emergency  situations  vdiich  call  for  important 
decisions  with  little  or  no  advance  notice. 
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FACTOR  #9 

PHYSICAL  APPLICATION 

Degree    12    3    4    5 

points    5   15   27   42   60 

This  factor  measures  the  physical  activities,  worker 
characteristics,  amount  of  strength  and/or  endurance 
that  the  Job  usually  demands  of  the  worker.  Consid- 
eration should  be  given  to  the  frequency,  duration,  and 
intensity  of  the  physical  activities  as  well  as  the 
degree  of  the  worker  characteristics  required  in  the 
successful  performemce  of  the  Job, 


Degree 


1.  Light  physical  effort,  comfortable  working 
positions.   Handles  light  weights.   Intermittent 
sitting,  standing  and  walking. 

2.  Frequently  requires  light  physical  activity  or 
occasional  moderate  effort.  Hamdles  medium 
weight.  Uncomfortable  working  positions  such 
as  stooping,  crouching,  bending,  etc.  Manual 
dexterity  or  close  visual  work  required  frequently. 

3.  Moderately  heavy  physical  activity.  Occasionally 
required  to  push  or  pull  medium  heavy  objects. 
Difficult  working  positions.  Have  to  stsmd, 
walk,  or  sit  for  extended  periods,  constant 
close  visual  work.  Continuous  fast  manipulation 
with  a  high  degree  of  dexterity. 

4.  Arduous  physical  work.   Continuous  work  with 
medium  heavy  weight  and/or  frequently  pushing, 
pulling,  or  lifting  of  heavy  weights.  Continuous 
standing,  sitting  or  walking.  Extremely  fast  con- 
tinuous manipulation  with  a  very  high  degree  of 
dexterity. 
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5.  Extremely  arduous  physical  work.  Continuous 
pushing,  pulling,  lifting  of  heavy  weights. 
Continuous  very  difficult  working  positions. 


light  weight  -  up  to  15  pounds 

mediixm  weight  -  16  to  30  pounds 

medium  heavy  weight  -  31  to  7  5  pounds 

heavy  weight  -  76  pounds  or  over 
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FACTOR  #10 

ACCIDENT  OR  HEALTH  HAZARDS 

Degree    12    3    4    5 

Points    5   15   27   42   60 

This  factor  appraises  the  hazards,  both  accident  and 
health,  connected  with  or  surroxindlng  the  Job,  even  though 
safety  devices  have  been  Installed, 

Degree 

1.  No  health  hazard.  Possibility  of  minor  injuries 
such  as  abrasions,  contusions  and  cuts,  but 
reasonable  care  will  assure  personal  safety  and 
well-being, 

2.  The  Job  and  equipment  used  occasionally  exposes 
persons  to  hazards  that  might  result  in  more 
serious  cuts,  bruises,  burns  or  allergies.  Most 
injxiries  or  illnesses  due  to  Job  would  be  minor 
but  could  result  in  temporary  disabilities. 

3.  Possibility  of  accidents  or  health  hazards  ex- 
ists due  to  contact  with  infectious  patients, 
handling  of  sterilizing  equipment  and  like  sit- 
uations involving  intermittent  hazards  or  pos- 
sible accidents. 

4.  Frequent  minor  injuries  or  illnesses  possible. 
Frequent  exposure  to  contagious  diseases  which  re- 
quire careful  preventive  measures.   Could  result 
in  considerable  lost  time.  Definite  possibility 
exists  for  eye  injuries,  loss  of  fingers  or  toes, 
emd/or  serious  burns. 

5.  Constant  exposvure  to  contagious  diseases  and  acute 
hazards  that  might  well  result  in  either  permanent 
or  long  term  disability.  Accidents  likely  to 
happen  in  spite  of  normal  precautions  and  safe- 
guards. 
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